-- Logs begin at Wed 2022-08-24 09:47:46 UTC, end at Wed 2022-08-24 10:56:35 UTC. -- Aug 24 10:19:32.744824 dv-cinder-854273-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 10:19:32.752347 dv-cinder-854273-2-smb devstack@keystone.service[81642]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:19:32 2022] *** Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: nodename: dv-cinder-854273-2-smb Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: machine: x86_64 Aug 24 10:19:32.754311 dv-cinder-854273-2-smb devstack@keystone.service[81642]: clock source: unix Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: pcre jit disabled Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: detected number of CPU cores: 4 Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: current working directory: / Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: your processes number limit is 47680 Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: your memory page size is 4096 bytes Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: detected max file descriptor number: 2048 Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: lock engine: pthread robust mutexes Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: thunder lock: enabled Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 10:19:32.754725 dv-cinder-854273-2-smb devstack@keystone.service[81642]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:19:32.801230 dv-cinder-854273-2-smb devstack@keystone.service[81642]: Python main interpreter initialized at 0x5602bfb5f9c0 Aug 24 10:19:32.801230 dv-cinder-854273-2-smb devstack@keystone.service[81642]: python threads support enabled Aug 24 10:19:32.801230 dv-cinder-854273-2-smb devstack@keystone.service[81642]: your server socket listen backlog is limited to 100 connections Aug 24 10:19:32.801230 dv-cinder-854273-2-smb devstack@keystone.service[81642]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:19:32.801589 dv-cinder-854273-2-smb devstack@keystone.service[81642]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:19:32.801693 dv-cinder-854273-2-smb devstack@keystone.service[81642]: *** Operational MODE: preforking *** Aug 24 10:19:32.801975 dv-cinder-854273-2-smb devstack@keystone.service[81642]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:19:32.801975 dv-cinder-854273-2-smb devstack@keystone.service[81642]: spawned uWSGI master process (pid: 81642) Aug 24 10:19:32.802184 dv-cinder-854273-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 10:19:32.803039 dv-cinder-854273-2-smb devstack@keystone.service[81642]: spawned uWSGI worker 1 (pid: 81655, cores: 1) Aug 24 10:19:32.803131 dv-cinder-854273-2-smb devstack@keystone.service[81642]: spawned uWSGI worker 2 (pid: 81656, cores: 1) Aug 24 10:19:32.805884 dv-cinder-854273-2-smb devstack@keystone.service[81642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:19:37.158555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:19:37.158555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: from cryptography.utils import int_from_bytes Aug 24 10:19:37.159339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:19:37.159339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: from cryptography.utils import int_from_bytes Aug 24 10:19:37.161473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:19:37.161473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: from cryptography.utils import int_from_bytes Aug 24 10:19:37.161975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:19:37.161975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: from cryptography.utils import int_from_bytes Aug 24 10:19:37.214576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:19:37.214763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:19:37.214943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] command line args: [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:19:37.215148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:19:37.215231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:19:37.215340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:19:37.215420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ================================================================================ {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:19:37.215532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] command line args: [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:19:37.215619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] admin_token = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.215818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:19:37.215912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] config_dir = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.215990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ================================================================================ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:19:37.216067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] config_source = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] admin_token = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_dir = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] debug = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.216876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_source = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] debug = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.217976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_config_append = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_dir = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_config_append = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_file = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.218818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_dir = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.219993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.220947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.221866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] publish_errors = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.222968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] publish_errors = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.223923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.227572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.227690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] standard_threads = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.227770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] standard_threads = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.227875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.227948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] use_journal = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_journal = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] use_json = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_json = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] use_stderr = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_stderr = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] use_syslog = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_syslog = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.228923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.229004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:19:37.229076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.229996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.230951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.231868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.232931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.233990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.234944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.235982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.236991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.237994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.238982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.239985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.240998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.241939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.242992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.243905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.244969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.245965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.246892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.247005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.247117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.247238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.247354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.248947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.249996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.250926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.external = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.external = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.251925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.password = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.token = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.password = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] auth.token = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.252998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.253999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.254986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.255930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.273957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.274954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.275943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.276960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.277969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.278893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.279935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.280961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.281944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.282947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.283980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.284948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.285968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.286976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.287931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.288931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.289956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.290992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] role.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.291971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] role.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.292985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.293983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.294908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.295746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.302080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.302734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.302817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.302881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.302953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.303939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.304976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.305988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.306977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.connection = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.307987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:19:37.308780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:19:37.329652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.329876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.329989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.330092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.330223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.330446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.338522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.339037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.367215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.367437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.367797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.368033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.422771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.422945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.471470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.471692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.472356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.472596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.632660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.632884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.633922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.634141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.634360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.663468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.663702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.663951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.664975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.665195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.665413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.665630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.683479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.683640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.696988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.697932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.698096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:19:37.714799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.715009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.715107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:19:37.715214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:19:37.715337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.715536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:19:37.715628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.715749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:19:37.715855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.716082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.716174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.716853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.721849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.721849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.721988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.721988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.726617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.726885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.727145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.727260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.727423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.727539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.727755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.728075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.734366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.735254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.737288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.737572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.737855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.738469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.738959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.739943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.740137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.741180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.741261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.741261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.741261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.763865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.769963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.770133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.770223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.770300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.770300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.770440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.770546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.770828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.772019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.772310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.772596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.777173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.777461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.779156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.779588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.781600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.781887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.782169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.782451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.782726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.783000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.783269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.783538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.783757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.784083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.784374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.784663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.784944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.785223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.785499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.785776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.800933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.801208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.803438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.803735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.805070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.807697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.808288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.808593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.811804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.812107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.813347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.816448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.816621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.819641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.819739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.819984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.820269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.820554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.820842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.821140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.822939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.823248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.823543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.823863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.824167 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.824463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.837692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.837988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.838253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.838515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.841392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.841923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.842282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.842566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.845569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.847088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.847365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.849532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.850012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.850297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.850586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.850889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.851431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.851550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.851664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.855342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.855633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.855956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.856264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.856552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.863080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.863431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.863694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.863994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.864277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.864549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.864833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.868265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.868558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.868848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.869132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.869417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.869743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.870005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.880773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.883808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.886510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.886680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.888819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.890330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.890480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.890617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.891057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.893479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.894928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.896450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.896739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.897033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.897375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.899667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.901699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.901990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.902273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.902551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.903602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.905443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.908388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.908686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.908976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.909262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.910519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.910810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.911089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.917327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.924907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.924907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:19:37.925902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.925902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.926171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.926451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.926728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.927005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.927285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.927581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.927881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.928171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.928437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.928714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.928979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:19:37.962836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602bfb5f9c0 pid: 81656 (default app) Aug 24 10:19:37.962836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee9dd-0443-47fb-90d3-6dcb3228c9ad None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:37.962836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee9dd-0443-47fb-90d3-6dcb3228c9ad None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:37.962836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee9dd-0443-47fb-90d3-6dcb3228c9ad None None] PATH_INFO: `/v3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:37.964555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Wed Aug 24 10:19:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:37.964886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602bfb5f9c0 pid: 81655 (default app) Aug 24 10:19:45.638735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:45.639223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:45.639223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:45.640522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:45.649566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:45.649970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:45.650113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:45.723173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: INFO dbcounter [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] Registered counter for database keystone Aug 24 10:19:45.743614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG oslo_db.sqlalchemy.engines [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:19:45.750754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writer thread running {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:19:45.934964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG passlib.handlers.bcrypt [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81655) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:19:45.935576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG passlib.handlers.bcrypt [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81655) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:19:45.990367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:45.992019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:46.122126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 10:19:46.576893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:46.645425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: INFO dbcounter [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] Registered counter for database keystone Aug 24 10:19:46.667368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG oslo_db.sqlalchemy.engines [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:19:46.673698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writer thread running {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:19:46.792527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc1ba-bd4c-48e0-a64a-3d9cfd1950fd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:46.796831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:46.797458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:46.797738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:46.798009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:46.805984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:46.857848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:19:46.858128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9fae-9c8c-4daa-a06b-dbfcb57d8079 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:46.867499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 24 10:19:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:46.874208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:46.889019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591d02-e833-44ed-89c8-d808fb3e5132 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:46.893445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:46.894527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:46.894804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:46.895070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] PATH_INFO: `/v3/projects/81ae17c3c2d745c786962a42b9714f09` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:46.896573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] RBAC: Authorizing `identity:get_project(project_id=81ae17c3c2d745c786962a42b9714f09)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:46.953086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:19:46.953422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe099c99-86bd-453b-8081-6ff968c7d3df admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:46.958070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 2/5] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Aug 24 10:19:46 2022] GET /identity/v3/projects/81ae17c3c2d745c786962a42b9714f09 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:48.847685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5db2-5dae-4b29-8188-3173e8301799 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:48.848288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5db2-5dae-4b29-8188-3173e8301799 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:48.848288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5db2-5dae-4b29-8188-3173e8301799 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:48.852633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 4/6] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:48.858646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:48.859024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:48.859189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:48.879176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:48.880748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:48.888486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 10:19:49.156772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5db2-5dae-4b29-8188-3173e8301799 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:49.168751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5db2-5dae-4b29-8188-3173e8301799 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:49.173700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:49.174293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:49.174572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:49.174842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:49.182459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:49.184270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ee367-ba40-4b29-93bb-1f6df86f277a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:49.193578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 24 10:19:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:49.198914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:49.208313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33b933-b07c-4891-aafd-8f77c9226b06 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:49.212637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:49.213263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:49.213544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:49.213818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:49.215114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:49.217609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f00f47-35d3-40e1-94f5-76a5462bd452 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:49.219131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 4/9] 10.222.0.50 () {56 vars in 1198 bytes} [Wed Aug 24 10:19:49 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:51.208812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe530-fb67-4c2b-9428-fff04737caf8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.209385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe530-fb67-4c2b-9428-fff04737caf8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.209385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe530-fb67-4c2b-9428-fff04737caf8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.210692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:51.215437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f515-2807-407a-af58-de2ba6338ea2 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.215929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.216061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f515-2807-407a-af58-de2ba6338ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.216199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.216294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f515-2807-407a-af58-de2ba6338ea2 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.216445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.217582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 5/11] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:51.222587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.222867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.223142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.240916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:51.242103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:51.258936 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG passlib.handlers.bcrypt [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81656) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:19:51.259348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG passlib.handlers.bcrypt [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81656) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:19:51.305006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:51.306614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:51.321724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:19:51.407100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:19:51.590412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:51.616212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:51.679537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:51.697154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067d60-cac4-4905-8e9c-a331a62af233 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:51.730625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:51.731234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.732080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.732635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.784951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd95a49-6530-4e1d-a559-8c4f05fc63a3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:51.787213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:51.801046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:51.802525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:51.823013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:51.824245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.824530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.824812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.826786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:51.837293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:19:51.845857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:19:51.846821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:19:51.847741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 8/14] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:19:51.854804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:51.902860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:51.909152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:51.957455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a331a-b9f3-4f9a-af18-839dc951ecb9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:51.991073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:51.991705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:51.992006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:51.992285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:51.992947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:51.993244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:51.994681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.007113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 9/16] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:52.009656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d553b-f2f9-43b8-8be2-3587424ff92a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:52.012647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:52.032786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:52.039592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:52.044740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:52.045371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:52.045649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:52.045920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:52.055916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:52.057416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:19:52.076916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:19:52.077932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:19:52.078734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:19:52.078734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:19:52.078734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:19:52.078734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 8/17] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:19:52.083691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:52.111724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc614cd-2dbc-4a94-a018-1e38d8cdbeb9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:52.146002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:52.146633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:52.146909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:52.147179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:52.148682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:52.150125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.151921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:19:52 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:52.157420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:52.187226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966de76-2566-4a67-9d24-1ea4ac4ccee0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:52.220071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:52.220685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:52.220932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:52.221197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:52.221826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:52.222121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:52.223495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.240458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:52.251062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:52.258170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f228bfa-74e5-4189-96db-1a878e197538 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:52.297120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:52.297774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:52.298054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:52.298324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:52.299577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:52.301133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14d748-c770-4103-872b-668fa45cac85 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.303008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:52.308907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:52.346014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:52.415020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20edb1d-fa9c-4a35-86f9-73d4d928df9d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:52.449794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:52.450541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:52.450826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:52.451196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:52.451835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.domain.id=default, user.id=b7197efde7064ffaa409cd8ec7c1f162) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:52.452150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:52.453623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b488a-efbb-455f-a71d-9a7fa61941ce None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:52.461405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Aug 24 10:19:52 2022] GET /identity/v3/role_assignments?user.id=b7197efde7064ffaa409cd8ec7c1f162&scope.domain.id=default&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:54.568292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1276-7228-4a13-b94f-5682cb32e9e2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.568784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1276-7228-4a13-b94f-5682cb32e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.568784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b1276-7228-4a13-b94f-5682cb32e9e2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.570401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:54.575879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3869d11-b55f-4cf8-9f43-1db67db024b2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.576395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3869d11-b55f-4cf8-9f43-1db67db024b2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.576707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3869d11-b55f-4cf8-9f43-1db67db024b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.604860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d3869d11-b55f-4cf8-9f43-1db67db024b2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:54.606085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d3869d11-b55f-4cf8-9f43-1db67db024b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:54.636486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5c60-56bf-4eb7-868f-1da6e1a6a31b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.636807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5c60-56bf-4eb7-868f-1da6e1a6a31b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.637035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5c60-56bf-4eb7-868f-1da6e1a6a31b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.639525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 13/23] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:54.645028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4943-9b25-42f6-9406-09f12346db7e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.645312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4943-9b25-42f6-9406-09f12346db7e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.645582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4943-9b25-42f6-9406-09f12346db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.672869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-73ec4943-9b25-42f6-9406-09f12346db7e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:54.674070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-73ec4943-9b25-42f6-9406-09f12346db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:54.733390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 11/24] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:54.771810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 14/25] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:19:54.870181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae75e-8cd8-47fa-b3f7-16942749815f None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.870550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae75e-8cd8-47fa-b3f7-16942749815f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.870933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae75e-8cd8-47fa-b3f7-16942749815f None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.872516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 12/26] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:54.877712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:54.878157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:54.878604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:54.905179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:54.906688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:55.001202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 15/27] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:55.112452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae75e-8cd8-47fa-b3f7-16942749815f None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.147726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.163381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.203829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.243300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae75e-8cd8-47fa-b3f7-16942749815f None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:55.324302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:55.324952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.325260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.325608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.352497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:19:55.357854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd992fc-46e4-405b-a9cf-26f7abcbc6eb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a9fbfaa5-2771-4060-ba3e-f979955f91f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:19:55.361907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:19:55.362964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:55.363933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:19:55.366310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 13/28] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:19:55.368185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a6f5-8891-405f-9f45-ca08d76972ef None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.368709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a6f5-8891-405f-9f45-ca08d76972ef None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.370440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a6f5-8891-405f-9f45-ca08d76972ef None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.376618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 14/29] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:55.377539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a6f5-8891-405f-9f45-ca08d76972ef None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.402666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:55.403204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.403697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.404086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.404918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:55.406553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2142b0-9446-4b7c-954d-ea615783312f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:55.491190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.505580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a6f5-8891-405f-9f45-ca08d76972ef None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:55.545845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:55.546860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.547411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.547949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.559191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:55.562072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:19:55.578491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:19:55.579855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:19:55.586573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:19:55.586573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:19:55.586573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:19:55.586573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 15/30] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:19:55.586573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.620381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 16/31] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 24 10:19:55 2022] POST /identity/v3/roles => generated 219 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:19:55.623342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.623666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.624033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.648793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:55.651158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:55.717194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbd1f0-e5c1-44d3-a7df-d3c8a179d7ae None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:55.738611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 17/32] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:55.739661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.770157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.786338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:55.787002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:55.787287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:55.787560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:55.788885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:55.789896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:55.791578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:55.829663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 16/33] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:55.851446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:55.854532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:55.969468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c9c2f-fa01-4f5e-b820-4a4da218ecae None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.019556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e8b1-3bc4-4954-a5e0-b745efc1bd1c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.044711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.045706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.045999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.046276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.046936 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:56.047239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.048861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.070143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.070795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.078183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.078183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.078183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.078183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.078183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 17/34] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:19:55 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:56.088012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 18/35] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:56.090498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:56.092406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:56.185573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:56.188378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:56.218646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c011-39ba-4f67-a1c7-bf387621b26f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.220585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9362-d7ef-467a-aae6-3edb845145e0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.256632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.257019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.257238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.257517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.257790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.258381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.258479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.258889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.259310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.259858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b518e6-04a8-4d95-8857-ab95de25d238 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.260814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.262399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.264456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 19/36] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:19:56.265392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:56.371171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99567b31-0247-443e-ad54-41f4c1fb0d60 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.406947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.407556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.407868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.408146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.408786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.410232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fae8b-aa33-4ff6-90b2-d03467ec6e32 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.430162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:56.523176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 20/37] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:19:56 2022] POST /identity/v3/projects => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:19:56.524378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d0c4-2b81-4acc-98bb-ea6d3c619467 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.524669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d0c4-2b81-4acc-98bb-ea6d3c619467 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.524947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d0c4-2b81-4acc-98bb-ea6d3c619467 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.526458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 21/38] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:56.526986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5d0c4-2b81-4acc-98bb-ea6d3c619467 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 18/39] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 24 10:19:56 2022] POST /identity/v3/roles => generated 225 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24f42d-60fe-4af3-8d2c-bfd7a3064c60 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24f42d-60fe-4af3-8d2c-bfd7a3064c60 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24f42d-60fe-4af3-8d2c-bfd7a3064c60 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 19/40] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f98c-1583-49a9-a43b-ec62a475e54c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.563865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f98c-1583-49a9-a43b-ec62a475e54c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.564475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f98c-1583-49a9-a43b-ec62a475e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.598291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a6f7f98c-1583-49a9-a43b-ec62a475e54c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:56.602271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a6f7f98c-1583-49a9-a43b-ec62a475e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:56.683074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5d0c4-2b81-4acc-98bb-ea6d3c619467 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:56.707582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 20/41] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:56.709245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.709722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.710139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.728944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:56.730358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:56.737381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:56.738178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:56.738461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:56.738732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] PATH_INFO: `/v3/domains/default/users/b7197efde7064ffaa409cd8ec7c1f162/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:56.742204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b7197efde7064ffaa409cd8ec7c1f162, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:56.744666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:56.801149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:56.812742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:56.853816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 22/43] 10.222.0.50 () {58 vars in 1361 bytes} [Wed Aug 24 10:19:56 2022] PUT /identity/v3/domains/default/users/b7197efde7064ffaa409cd8ec7c1f162/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:19:56.991331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:57.084825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:57.101585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741ea9-8b7b-41f2-a2e2-75e410fc4486 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:57.139825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:57.140735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:57.141350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:57.141647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:57.141920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:57.142554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:57.144099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:57.189120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bea94d-5840-4258-a5bb-5f04823f78af None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:57.202186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 24 10:19:56 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:19:57.227030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:57.227694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:57.228008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:57.228284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:57.229476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:57.230966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cbf7c-8898-4411-b96b-5989b12421f3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:57.233281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 23/45] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:57.239334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:57.300001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:57.360076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44241fd1-5f89-49a0-9bcc-f2db2d974a83 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:57.397542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:57.397542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:57.397953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:57.398124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:57.400080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:57.400275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d62fd-5097-41c7-8e22-50ced99abc03 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:57.477462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:19:57 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:19:58.782606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90d77-9d12-4a6e-bfe9-888bc528bf86 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:58.783164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90d77-9d12-4a6e-bfe9-888bc528bf86 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:58.783164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b90d77-9d12-4a6e-bfe9-888bc528bf86 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:58.784503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 24/47] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:19:58.789992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:58.790393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:58.790563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:58.809096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:58.810564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:58.878809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:59.150992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b90d77-9d12-4a6e-bfe9-888bc528bf86 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.255199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b90d77-9d12-4a6e-bfe9-888bc528bf86 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.275023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:59.289314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:59.289948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.290226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.298800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.302698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2b81912e-8ebd-4e11-b840-5533d67da85c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:19:59.307793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:19:59.308622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:19:59.310310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 25/49] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:19:59.316211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.345660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:59.390313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861583-a156-486c-b24a-2574668ec81d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.390606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861583-a156-486c-b24a-2574668ec81d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.390886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861583-a156-486c-b24a-2574668ec81d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.392277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 26/50] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:19:59.397234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.397522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.397799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.415974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:19:59.417023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43679-2159-4537-bdf4-68af5950c403 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.417140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:19:59.451160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:59.451761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.452067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.452345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.453001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:19:59.453302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:59.454686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:59.462750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 25/51] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:59.468906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.487637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 27/52] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:19:59.560670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:59.567202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45536-4087-4f8d-8b87-08f323e2be1e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.602241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:59.602866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.603149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.603424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.604606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:59.606120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:59.608368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:59.613974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.759415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.820568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84aae6-6d13-4831-95ef-a473fa1948a4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.832446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:59.855772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:59.856495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.856776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.857054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.858301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:59.860196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:59.861759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 28/54] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:59.862495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85f29-ed92-463d-920f-30ba0018d941 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.867527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.897562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:19:59.898191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:19:59.898471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:19:59.898745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:19:59.899878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:19:59.901328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:19:59.902892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:19:59.908951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:19:59.942053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:59.965445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d010-6ff0-4cd2-a6e9-0f61841b8f77 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:19:59.999476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:00.000116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:00.000392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:00.000659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:00.001398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.domain.id=default, user.id=b7197efde7064ffaa409cd8ec7c1f162) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:00.001743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:00.003169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635bfd3-0f4f-472a-a934-7b32376d8af7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:00.011101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 29/56] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Aug 24 10:19:59 2022] GET /identity/v3/role_assignments?user.id=b7197efde7064ffaa409cd8ec7c1f162&scope.domain.id=default&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:00.011877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e64cd-098b-4864-8cc3-158cddb67042 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:00.052447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:00.053069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:00.053350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:00.053619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:00.054292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:00.055880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169df60-2162-4007-b6a2-175d802fe95b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:00.117330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 28/57] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Aug 24 10:19:59 2022] POST /identity/v3/projects => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:20:02.014265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f248-9bd4-4dc4-8323-3435393c63ca None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:02.014781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f248-9bd4-4dc4-8323-3435393c63ca None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:02.014864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f248-9bd4-4dc4-8323-3435393c63ca None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:02.016203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 30/58] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:02.021414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:02.021830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:02.021968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:02.039817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:02.041606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:02.105345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 29/59] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:02.375859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f248-9bd4-4dc4-8323-3435393c63ca None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:02.421216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:02.478082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f248-9bd4-4dc4-8323-3435393c63ca None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:02.511653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:02.512303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:02.514083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:02.514083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:02.514699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:02.516245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e36a9d-5763-464c-a744-97f813165706 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:02.517814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 31/60] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:02.523309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:02.537213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:02.620697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15afe2d-91ae-4521-a2d2-0f08c89f5e21 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:02.654132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:02.654729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:02.655018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:02.655390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:02.656064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:02.657510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d5e8-cddf-4be7-9bea-f2fbe3bcb815 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:02.742573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 30/61] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:02 2022] POST /identity/v3/users => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:20:05.811674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d135-d6df-4e17-af7f-66cf604ee7c7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:05.812776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d135-d6df-4e17-af7f-66cf604ee7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:05.813272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d135-d6df-4e17-af7f-66cf604ee7c7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:05.814850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 32/62] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:05.820522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11499-7415-4a49-abd3-7e45c7a8b3dc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:05.821397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11499-7415-4a49-abd3-7e45c7a8b3dc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:05.822011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11499-7415-4a49-abd3-7e45c7a8b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:05.848812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-70f11499-7415-4a49-abd3-7e45c7a8b3dc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:05.850357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-70f11499-7415-4a49-abd3-7e45c7a8b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:05.937250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:05.945468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 31/63] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:05.998364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4d39-e729-473f-aa50-f531a1158f8f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:05.998752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4d39-e729-473f-aa50-f531a1158f8f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:05.998950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4d39-e729-473f-aa50-f531a1158f8f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.000476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 33/64] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:06.005617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdb298-b466-40d9-b3fe-90bf3f7b88f6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.005942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdb298-b466-40d9-b3fe-90bf3f7b88f6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.006222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdb298-b466-40d9-b3fe-90bf3f7b88f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.032840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7fcdb298-b466-40d9-b3fe-90bf3f7b88f6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:06.034126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7fcdb298-b466-40d9-b3fe-90bf3f7b88f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:06.136539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 32/65] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:06.152452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740124-ef40-4503-b7b7-b2fa534cb924 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.152752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740124-ef40-4503-b7b7-b2fa534cb924 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.153012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740124-ef40-4503-b7b7-b2fa534cb924 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.155084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 34/66] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:06.160365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.160682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.160927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.189697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:06.190890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:06.218163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bf91-20ae-4307-90b3-93a27e90851a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.218478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bf91-20ae-4307-90b3-93a27e90851a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.218716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bf91-20ae-4307-90b3-93a27e90851a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.220082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 35/67] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:06.226322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.226583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.226935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.255775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:06.257018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:06.300535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 33/68] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:06.306103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.367469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:06.410866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca218e8-23b3-419d-b479-4b8a512383d6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.412169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 36/69] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:06.413268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.446451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.447323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.447751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.448669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.459771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:06.464809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:06.465859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:06.467535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:06.469522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 34/70] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:06.475254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.535507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:06.592802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca0cb-d3c3-4ba4-a565-21854eeb0648 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.620720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:06.636118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb846c2-6aff-49ac-a4dd-17a287257290 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.638264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.638871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.639146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.639412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.640195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:06.640488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:06.641889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:06.650971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:06.656279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.673349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.673978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.674254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.674526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.686220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-99bdc5cc-060e-479b-9649-2aad357cd3b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:06.691269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:06.692147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:06.692901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 37/72] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:06.693973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3272be8-7bd5-4b1f-b514-cae61b5c38a2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.694253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3272be8-7bd5-4b1f-b514-cae61b5c38a2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.694520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3272be8-7bd5-4b1f-b514-cae61b5c38a2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.695740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 38/73] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:06.696446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3272be8-7bd5-4b1f-b514-cae61b5c38a2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.765285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7874d-98e5-40ed-9896-91959b3d0b74 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.793695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:06.797468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3272be8-7bd5-4b1f-b514-cae61b5c38a2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.801135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.801135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.801135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.801135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.809123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:06.814789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:06.815969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:06.816745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 36/74] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:06.817433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.833053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.833682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.833966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.834240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.850096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:06.851838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:06.853480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 39/75] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:06.854254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:06.861988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:06.921082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029224-d902-4c33-83da-5aa50345ac86 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.956375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.956929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.957211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.957485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.957826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479678-f818-4440-b66e-8a4b56329d2c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:06.967612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-b88595e5-8a26-4fff-852c-689bc78147f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:06.972748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:06.973697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:06.974443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 37/76] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:06.975095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.975336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.975764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.993177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:06.993791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:06.994401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:06.994584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:06.994676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:06.994939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:06.995602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:06.995938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:06.998037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.006291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.011059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.032679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.062441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 38/78] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:07.063299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.095185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.117797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ff7e-1964-46af-9a1d-9c66bcd91bcf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.155639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.156374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.156664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.157063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.157718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:07.158025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.159418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.168489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 41/79] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.169282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.176080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f860b-f822-4ea0-99a5-c4ddaae0c94e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.211569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.212439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.212724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.212999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.259899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.280896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0401-5d5c-4b6d-84bf-e3dcb4b4ae4d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.292531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.294751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.326476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.327232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.327666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.327949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.328680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:07.329053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.329978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.330556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.340786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 42/80] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.342430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.402845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 39/81] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:07.404345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.443764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc05a3a-9974-460e-b95a-527f106a6bbc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.476518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.477070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.477352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.477624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.478760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.480225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.482337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 43/82] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.483110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.498333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.510184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21dfd0-82e9-4822-8c25-a6c6ea5e4cb2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.537606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.543229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.543883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.544659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.544969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.546216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.547665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.549265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 40/83] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.550017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.584568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9b56c-624e-4595-a0e4-6502b2a76c85 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.618943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.619567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.619870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.620154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.624497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.625933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.627680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 44/84] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.628309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.650682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd833-2ecc-4c4f-806e-d6201bdb783d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.684009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.684629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.684905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.685172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.686288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.687723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.689327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 41/85] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.690076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.708167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.727653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5aa3c-2f09-430c-848f-25b6ce24d6fb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.755693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.762145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.762778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.763149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.763366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.764552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.770113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.770113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 45/86] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:07.770113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:07.793703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7633-841d-4bd9-9f4b-f04c5c39d7ef None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.829080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.829689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.829978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.830253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.868040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6d410-444a-4caa-88ec-0aca2b3f244d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:07.896825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.898296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.900871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:07.901473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:07.901751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:07.902019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:07.920710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.961413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:07.969325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:07.970793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:07.997930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 42/87] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:07.998752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.073404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 46/88] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:08.074250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.097204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b37b-22ed-4b9d-9a0a-e299d4328e2d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.123883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.131931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.132622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.132950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.133226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.133872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.135340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.173745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006bcd4-62c5-4656-b7ed-70db11750fed None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.205977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.206572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.206847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.207120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.217870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 43/89] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:07 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:08.218713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.250076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.293012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.297882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.342913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535adf0-d26b-4dde-9c46-5d6ff7f07a01 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.355088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.391282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.391930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.392217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.392490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.393226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:08.393533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.394993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.401678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 44/90] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:08.402505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.417546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 47/91] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:08.418628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.531498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.555088 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e7792-ab4a-4b14-abe2-60f57c31ab62 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.555594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750342a-4463-40b3-9345-0ff1971bd461 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.604693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.605800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.606255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.606724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.608676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.610040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.610746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.610949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.611089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.611495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.612780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.613572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 45/92] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:08.614183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.615267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.617209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 48/93] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:08.621947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.655578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.749607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f501b0-57b1-412d-9acc-2bc31718339d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.751488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61bbd6-4088-41bc-a7ac-d2208061c904 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:08.798917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.799475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.799752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.800276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] PATH_INFO: `/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.802699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] RBAC: Authorizing `identity:get_project(project_id=225a6a8e2a18462b9dbdc635d2bdde91)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.804157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.807537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 46/94] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:08.811868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:08.812493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:08.812717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.812834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:08.813025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:08.813843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=b7197efde7064ffaa409cd8ec7c1f162) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:08.814153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:08.815600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:08.834244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 49/95] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/role_assignments?user.id=b7197efde7064ffaa409cd8ec7c1f162&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:08.835170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:08.845962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:08.938953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915f615-dc26-419b-bde9-d727494cfe6c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:09.001274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:09.001912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:09.002192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:09.002464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:09.003210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:09.003521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:09.005033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82054fc3-e6bd-40c8-a39e-eec7f0a113e5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:09.016383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 47/96] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=040e823c6d874b98830778582091d28a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:09.028202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:09.054205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae5a18-c9fb-484e-8359-dfeb6a5b713b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:09.112021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:09.112668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:09.112952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:09.113225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:09.114218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=225a6a8e2a18462b9dbdc635d2bdde91, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:09.114815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:09.116594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2fdb0-57b6-4fb5-a015-9322467312ff None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:09.127033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 50/97] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:08 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=225a6a8e2a18462b9dbdc635d2bdde91&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:10.671803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15da6-6c1a-45a6-8dad-dd2977d7d8d7 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:10.672312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15da6-6c1a-45a6-8dad-dd2977d7d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:10.672399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b15da6-6c1a-45a6-8dad-dd2977d7d8d7 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:10.673710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 48/98] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:10.679266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4a1d-7a4b-49a6-bb0f-cd20d1564f36 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:10.679671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4a1d-7a4b-49a6-bb0f-cd20d1564f36 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:10.679922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4a1d-7a4b-49a6-bb0f-cd20d1564f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:10.704800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-321f4a1d-7a4b-49a6-bb0f-cd20d1564f36 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:10.706019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-321f4a1d-7a4b-49a6-bb0f-cd20d1564f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:10.788508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 51/99] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:10.993001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bcdc4-2439-44bd-8311-7253f7143002 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:10.993330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bcdc4-2439-44bd-8311-7253f7143002 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:10.993519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bcdc4-2439-44bd-8311-7253f7143002 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:10.994828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 49/100] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:11.000640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.000933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.001214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.028867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:11.030472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:11.113300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 52/101] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:11.137116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bcdc4-2439-44bd-8311-7253f7143002 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:11.232998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.246023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bcdc4-2439-44bd-8311-7253f7143002 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:11.282856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:11.283562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.283875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.284153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.297999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f48dd37e-c077-4f2b-91aa-307991f3c711 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:11.303803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:11.304645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:11.305424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 50/102] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:11.311408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:11.332168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.393612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2cd3-a2af-4e58-b329-0aaf1d5c297b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.393915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2cd3-a2af-4e58-b329-0aaf1d5c297b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.394174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2cd3-a2af-4e58-b329-0aaf1d5c297b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.395593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 51/103] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:11.400997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.401280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.401557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.428878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:11.430123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:11.457195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af4f4-2e65-43af-90af-1c461604fe28 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:11.530903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:11.531444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.531729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.532029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.532703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:11.533007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:11.534395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:11.539953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 52/104] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:11.548062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 53/105] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:11.556912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:11.558706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:11.691215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.716784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:11.756856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135de91-23f8-4a0f-9481-3da5da6088c6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:11.766917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6e81e-86b9-4bb8-ad77-e055dee5bad0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:11.831878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:11.836500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.837271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.837562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.843576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:11.844260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:11.844543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:11.844817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] PATH_INFO: `/v3/users/7c896a3f38944794bd69387917f623b9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:11.868915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:11.881181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:11.882036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:11.882797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 54/106] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:11.887341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] RBAC: Authorizing `identity:get_user(user_id=7c896a3f38944794bd69387917f623b9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:11.889747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:11.891475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 53/107] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/users/7c896a3f38944794bd69387917f623b9 => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:11.896561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:11.898301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.110071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ebe4c-5c3f-4b82-af38-9dba2ff8e83b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.121730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d425f-fd9a-4348-8633-a5b7265b12af None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.164774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.165142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.165763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.166047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.166320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.170908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.177367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.177981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.178265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.178540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.179210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:12.182323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.182323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.190523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 55/108] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:12.191508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.248851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.250325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc321a0a-305c-4d1d-aca7-0c8021b1b451 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.301924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c59-b48d-4046-963e-53348088af8b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.338056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.338691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.338969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.339238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.340367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.342601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c1465-d4dc-4b12-84dc-66ea5b71936e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.344208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 56/109] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:12.347917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838480-a28a-41e8-9a53-be5ab019af5f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.347917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838480-a28a-41e8-9a53-be5ab019af5f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.347917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838480-a28a-41e8-9a53-be5ab019af5f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.347917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 57/110] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:12.347917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81838480-a28a-41e8-9a53-be5ab019af5f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.366588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 54/111] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:12.367903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925327-0d89-49b8-8d7c-2deaa36044fe None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.368089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925327-0d89-49b8-8d7c-2deaa36044fe None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.368370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925327-0d89-49b8-8d7c-2deaa36044fe None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.369759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 55/112] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:12.373126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187152-8d20-436a-8618-0b2ce3467b64 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.373411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187152-8d20-436a-8618-0b2ce3467b64 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.373695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187152-8d20-436a-8618-0b2ce3467b64 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.374944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 56/113] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:12.375661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187152-8d20-436a-8618-0b2ce3467b64 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.407396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.410318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.452439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81838480-a28a-41e8-9a53-be5ab019af5f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.476236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187152-8d20-436a-8618-0b2ce3467b64 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.486939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.487572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.487883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.488166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.489301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.490766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da646-5034-43bb-98b0-5c51f23e38cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.492383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 58/114] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:12.497115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.497115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.497115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.510646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.511256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.511359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:12.511533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.511834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.512478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.512579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:12.514477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d17df5-0a4f-4bd5-b942-c0ff06596209 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.579029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 59/115] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:12.579889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.599078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 57/116] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:20:12 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:12.600806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d9a5-b9ba-443f-b5b9-a4d0fe317493 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.601097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d9a5-b9ba-443f-b5b9-a4d0fe317493 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.601373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d9a5-b9ba-443f-b5b9-a4d0fe317493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.643297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8725d9a5-b9ba-443f-b5b9-a4d0fe317493 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:12.643297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8725d9a5-b9ba-443f-b5b9-a4d0fe317493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:12.645445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.705712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06635c6c-9090-4eed-8f80-26f70e499572 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.732890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 58/117] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:12.734375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.734761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.735128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.754516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.754709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:12.755547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.755989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.756135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:12.756528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.757813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.760929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.762753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 60/118] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:12.764301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.771083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.838166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 59/119] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:12.843262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.897872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ac29-4337-4fef-a2f2-f9d75d92e814 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:12.926408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:12.941088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:12.942294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:12.946542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:12.946542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:12.946542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:12.946542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:12.948474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 61/120] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:12.952575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:12.973296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b211752-53a7-4766-9955-57257f5fe83e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.014435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.015307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.015725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.016262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.017132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=7c896a3f38944794bd69387917f623b9) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:13.017580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:13.019168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:13.025173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 60/121] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/role_assignments?user.id=7c896a3f38944794bd69387917f623b9&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=01d728abd8844cb394ddaa2629c81871 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:13.026235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.042349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.071063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d4f1-5e6d-4d86-8829-e0e8f4a32d8b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.119905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.120569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.120847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.121346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.146163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:13.151845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:13.152674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:13.153462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:13.172518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 62/122] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:13.173885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.200585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4fa1e-242e-4167-9cd4-f6b150213b42 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.254030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.257197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003537fe-c806-4039-b935-c50af4064932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.257197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003537fe-c806-4039-b935-c50af4064932 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.264530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003537fe-c806-4039-b935-c50af4064932 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.264530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003537fe-c806-4039-b935-c50af4064932 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/46d6f6c7d946446f809757021f629631/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.264530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003537fe-c806-4039-b935-c50af4064932 None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, user_id=46d6f6c7d946446f809757021f629631, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:13.264530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003537fe-c806-4039-b935-c50af4064932 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:13.312328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778cbf0-f11c-47a5-b891-0fc3ca9e1786 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.346698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 61/123] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:13 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/46d6f6c7d946446f809757021f629631/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:13.347635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003537fe-c806-4039-b935-c50af4064932 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.352719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.353436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.353718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.353995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.379703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:13.385526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:13.387773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 63/124] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:13.388927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.435463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.515641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003537fe-c806-4039-b935-c50af4064932 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.579050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.579667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.579982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.580262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.580943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:13.582317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:13.583155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:13.593408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 62/125] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:13.594357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.597439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec9c5-0f20-4552-b1e3-3d88abff3dbb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.616974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.643825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.644717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.645133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.645539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.662510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:13.669477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:13.670346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:13.671187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:13.673254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 64/126] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:13.681075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.773702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ef6ab-de82-4861-bc09-a00a1e37684e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.836450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.848075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.848737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.849024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.849297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.849973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:13.850277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:13.851952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:13.867736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ec61-9d63-4ea7-ab4f-b56c505164e2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:13.872306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 63/127] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:13.873267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:13.937017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:13.937666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:13.937947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:13.938222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:13.942026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:13.943505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:13.948086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 65/128] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:13.952437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.008213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:14.068730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6d498-98d3-4258-b6d1-7ebbcfd7c105 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.128251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37e6a-e06a-4ddd-9c1e-60479316d703 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.144509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.145143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.145427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.145703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.146391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:14.146695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.148133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.165698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.165995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 64/129] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.166621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.166833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.167002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.167144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.173851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.174521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.176494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 66/130] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:13 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.178402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.258850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:14.302421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea630-36c0-4692-9bd8-9a79289abca8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.310753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ef81-8504-41b2-99f2-0ded53e49503 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.332306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:14.348232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.348952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.349237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.349515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.352716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.361707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.361707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.361707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.361707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.361986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.361986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 67/131] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:14 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.362123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.362189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.363213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.366855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 65/132] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:14 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.367624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.530960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828a30-a452-4ecf-917f-994be9fa97d4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.556915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:14.557941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c1643-1cf6-4c3e-b53a-e1acd4a1226d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.573964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.578221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.578221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.578221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.579953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.581634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.586953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 66/133] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:14 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.596392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.633273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.634900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.636693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.637169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] PATH_INFO: `/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.640052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] RBAC: Authorizing `identity:get_project(project_id=225a6a8e2a18462b9dbdc635d2bdde91)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.641713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.648415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 68/134] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:14 2022] GET /identity/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:14.649444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.736162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:14.756834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c57c-98e2-464d-aed8-0f0d271a3bca None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.806046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.806775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.806999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.807278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/b7197efde7064ffaa409cd8ec7c1f162/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.812606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, user_id=b7197efde7064ffaa409cd8ec7c1f162, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.814263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.827676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e11e1-ad58-46ef-9a2b-d2a34d6eeb30 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:14.864964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:14.865558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:14.865843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:14.866121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/46d6f6c7d946446f809757021f629631/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:14.868359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, user_id=46d6f6c7d946446f809757021f629631, role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:14.870185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ef88-5434-4d28-857e-e7980624e0fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:14.911418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 67/135] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:14 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/b7197efde7064ffaa409cd8ec7c1f162/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:14.912370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:14.968873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 69/136] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:14 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/46d6f6c7d946446f809757021f629631/roles/040e823c6d874b98830778582091d28a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:15.003550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:15.082704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1174a69-5669-4bf7-97dd-8bd755c34f96 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:15.126043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:15.126641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.126927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.127204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] PATH_INFO: `/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91/users/46d6f6c7d946446f809757021f629631/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.129263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=225a6a8e2a18462b9dbdc635d2bdde91, user_id=46d6f6c7d946446f809757021f629631, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:15.130790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672e7b9-bc2a-4198-abbb-e3dd52e694e0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:15.198387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe18959-6744-434c-9b63-2ccbede7dfaf None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.198702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe18959-6744-434c-9b63-2ccbede7dfaf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.199016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe18959-6744-434c-9b63-2ccbede7dfaf None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.200742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 70/137] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:15.206909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c575-e0f6-4d65-9409-635dd68af9da None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.207249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c575-e0f6-4d65-9409-635dd68af9da None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.207537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c575-e0f6-4d65-9409-635dd68af9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.226874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 68/138] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:14 2022] PUT /identity/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91/users/46d6f6c7d946446f809757021f629631/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:15.237091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b467c575-e0f6-4d65-9409-635dd68af9da None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:15.238402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b467c575-e0f6-4d65-9409-635dd68af9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:15.320522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 71/139] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:15.458258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ca3c-60fc-4786-b263-9c000bdaf00d None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.458628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ca3c-60fc-4786-b263-9c000bdaf00d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.458825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ca3c-60fc-4786-b263-9c000bdaf00d None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.460675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 69/140] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:15.466126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a0ae-4d91-442f-9de7-7135c83b99fb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.466626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a0ae-4d91-442f-9de7-7135c83b99fb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.467089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a0ae-4d91-442f-9de7-7135c83b99fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.492153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-07d3a0ae-4d91-442f-9de7-7135c83b99fb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:15.493441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-07d3a0ae-4d91-442f-9de7-7135c83b99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:15.526527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:15.581195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 72/141] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:15.650217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ca3c-60fc-4786-b263-9c000bdaf00d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:15.747020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce442b-76a8-4dfc-9afb-ec1f6311ed31 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.747263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce442b-76a8-4dfc-9afb-ec1f6311ed31 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.748968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce442b-76a8-4dfc-9afb-ec1f6311ed31 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.759325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 73/142] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:15.771487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.771774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.772102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.805449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:15.806656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:15.812438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ca3c-60fc-4786-b263-9c000bdaf00d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:15.838641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:15.920685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 74/143] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:15.944501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:15.945443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:15.945932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:15.946391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:15.952457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:15.954143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:15.955945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 70/144] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:15.961590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.051623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.072165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:16.079994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c1bf-80ec-488e-9da0-b1ec49aabcd4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.132255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.132884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.133172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.133450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.134108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:16.135586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:16.272294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 75/145] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:15 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:16.273507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f89f17-f5c7-4e69-8e13-8ad73d993706 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.275728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.373546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.374116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.374395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.374663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.400740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:16.406732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:16.407569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:16.408771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 71/146] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:16.421265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.492120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82691919-2dda-49c7-8b30-a8ff6b146b7a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.536265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:16.558851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.559494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.559815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.560262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.581401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:16.594122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:16.595030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:16.596494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 76/147] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:16.602328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.620153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:16.648888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306b2d-5d1d-44ee-a7b1-1a9924b2bad5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.720653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.721499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.721913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.722320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.722831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75194b1-aca7-411b-87db-e5afe285f305 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.723164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:16.723467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:16.724883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:16.742896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 72/148] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:16.761913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.766027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.766639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.771807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.771807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.771807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:16.771807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:16.771807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:16.782522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 77/149] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:16.786839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.870800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:16.907770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb145-c527-441f-9abc-26cb2c73ae1b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.973360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:16.974088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:16.974272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:16.974545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:16.976156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:16.977965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:16.979724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 78/150] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:16.986573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:16.991413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbf317-f401-411f-b0f2-0d78fc770d33 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:16.993600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:17.056027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.057049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.057525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.058023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] PATH_INFO: `/v3/users/7c896a3f38944794bd69387917f623b9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.064688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] RBAC: Authorizing `identity:get_user(user_id=7c896a3f38944794bd69387917f623b9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.066510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.068519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 73/151] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/users/7c896a3f38944794bd69387917f623b9 => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:17.083973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:17.107981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670fb8-938e-49ec-af79-d7cbea6a506a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:17.148512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.149117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.149392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.149661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.161361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:17.224923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb4a1-d920-4852-bf56-822242f3df8f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:17.243924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.245575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.268871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.269952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.270476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.270939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.272404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.274209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.276370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 74/152] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:17 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:17.287339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:17.337271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:17.369972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 79/153] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:17.376442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:17.422239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367256f-4736-47f2-980a-bd3b27240887 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:17.438182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:17.463245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.463940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.464213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.464479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/7c896a3f38944794bd69387917f623b9/roles/01d728abd8844cb394ddaa2629c81871` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.466975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, user_id=7c896a3f38944794bd69387917f623b9, role_id=01d728abd8844cb394ddaa2629c81871)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.468819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cb8be-45d8-402f-a2a1-c84a9cbf9bb6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.525470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1785c1-582e-4a18-9856-1bbc8bcf88f1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:17.568599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.569613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.570123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.570592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.572044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.573771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.576380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 80/154] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:17 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:17.583585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:17.592152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 75/155] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:17 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/users/7c896a3f38944794bd69387917f623b9/roles/01d728abd8844cb394ddaa2629c81871 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:17.718400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee288-626e-4d52-9c8a-e6b0b0c06047 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:17.727552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:17.731484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6168a6-0b76-48e0-9493-902aded719c4 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.732423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6168a6-0b76-48e0-9493-902aded719c4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.732695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6168a6-0b76-48e0-9493-902aded719c4 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.738316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 76/156] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:17.739547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312be-889e-4d8c-b542-9c16926fe232 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.752325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312be-889e-4d8c-b542-9c16926fe232 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.752325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312be-889e-4d8c-b542-9c16926fe232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.780964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-172312be-889e-4d8c-b542-9c16926fe232 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:17.782185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-172312be-889e-4d8c-b542-9c16926fe232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:17.801223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:17.801903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:17.802186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:17.802455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:17.803197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:17.803617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:17.805214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:17.814088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 81/157] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:17 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:17.880200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 77/158] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:18.175518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:18.194552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a29cc-42ff-4a08-a3b5-d01e4c665253 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.195046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a29cc-42ff-4a08-a3b5-d01e4c665253 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.195118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a29cc-42ff-4a08-a3b5-d01e4c665253 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:18.196720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 78/159] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:18.205241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.205529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.205790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:18.228955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:18.230094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:18.259288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:18.313116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 79/160] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:18.346526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b1e5-ab1a-4921-897a-80f4ffea12a5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:18.409082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:18.409735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.410019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.410294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:18.422757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:18.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:18.428455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:18.429281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 82/161] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:18.434846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:18.552928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55c870-08a7-4a30-b374-33e434041da0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:18.588394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:18.593226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:18.601291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 80/162] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:18.607437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:18.640309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:18.712513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc8b6f-ef06-4dc0-892f-13a37a2f6ac4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:18.750001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:18.750642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.750913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.751176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] PATH_INFO: `/v3/users/b7197efde7064ffaa409cd8ec7c1f162` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:18.752349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] RBAC: Authorizing `identity:get_user(user_id=b7197efde7064ffaa409cd8ec7c1f162)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:18.753783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:18.755359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 83/163] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:18 2022] GET /identity/v3/users/b7197efde7064ffaa409cd8ec7c1f162 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:18.761323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:18.772725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:18.801032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:18.891873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3864-11b4-4070-9611-3dce65b59e56 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:18.935625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:18.936274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:18.936547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:18.936807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.005427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.015613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.017393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535bf52-9b7a-4aa5-8a90-4e93b04eb3bf None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.018202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7d94-8167-4e85-9124-3e8002ae1118 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.042175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.105018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.106137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.106137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.107145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.133183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:19.136596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 81/164] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:19.138721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefca9c-c0bd-4274-a9de-666e3bcfb331 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.139145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefca9c-c0bd-4274-a9de-666e3bcfb331 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:19.139254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:19.140328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:19.141266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:19.142444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefca9c-c0bd-4274-a9de-666e3bcfb331 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.143030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 84/165] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:19.145929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 82/166] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:19.147446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:19.151461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.152116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.152554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.174779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:19.176454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:19.260864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 83/167] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:19.263278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:19.321842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.381143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3162e0b-88ea-47ef-bd8b-78f3c78f2ce0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.410054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9c3ac-5ba6-42c0-a52c-4b77c0c328b5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.420986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.421842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.422286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.422746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.424036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:19.424507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.426107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.436412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 84/168] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:19.444143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:19.497604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.498450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.498838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.499183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.500480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.502018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.507804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 85/169] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:19.529609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:19.567840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d9d8-ea50-48c5-bc16-3be76ad06f14 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.583349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.609031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.610054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.610635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.611072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.612256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.614297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.616025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.617915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 85/170] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:19.627745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:19.748467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ce2c9-85d7-4182-bece-2a9c9e790d0d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.764677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53f1d-324b-48e6-9b28-2fdcbe21472f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:19.789455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.790555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.791000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.791445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.852146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:19.862841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:19.865346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:19.865810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:19.866245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:19.868527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=b7197efde7064ffaa409cd8ec7c1f162) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:19.869019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.870626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.876669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:19.878795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:19.886381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 86/171] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/role_assignments?user.id=b7197efde7064ffaa409cd8ec7c1f162&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:19.892592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.027604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 86/172] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:20.035209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.077073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:20.093443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02ef-3a4c-460a-983c-07efb180135c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.140344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:20.150574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.151219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.151498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.151766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.163390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9c16-b80e-4c44-987e-6933aa0f5ee0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.182349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:20.193481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:20.194402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:20.195749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 87/173] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:20.201913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.248005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af459598-d706-41a2-9972-812b6137016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.248642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af459598-d706-41a2-9972-812b6137016a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.248941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af459598-d706-41a2-9972-812b6137016a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.249181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af459598-d706-41a2-9972-812b6137016a None admin] PATH_INFO: `/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.251709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af459598-d706-41a2-9972-812b6137016a None admin] RBAC: Authorizing `identity:get_project(project_id=225a6a8e2a18462b9dbdc635d2bdde91)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:20.253208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af459598-d706-41a2-9972-812b6137016a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:20.254880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 87/174] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:20 2022] GET /identity/v3/projects/225a6a8e2a18462b9dbdc635d2bdde91 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:20.260782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af459598-d706-41a2-9972-812b6137016a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.410640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454de95-197d-4a60-a95b-79fdcab4e892 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.468149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.469825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.470917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.471548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.473318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:20.474037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:20.476478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e44043-9206-4d2c-b11b-c1d6ccdc3a28 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:20.482583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af459598-d706-41a2-9972-812b6137016a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.496464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 88/175] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:20.498983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557d85-b632-4dc2-a37c-b3f0aebcdc5d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.501296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557d85-b632-4dc2-a37c-b3f0aebcdc5d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.502872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d557d85-b632-4dc2-a37c-b3f0aebcdc5d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.504683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 89/176] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:20.510469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d557d85-b632-4dc2-a37c-b3f0aebcdc5d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.546881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:20.561484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.562108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.562384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.569296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.569296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=225a6a8e2a18462b9dbdc635d2bdde91, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:20.569296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:20.569296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9050ca4-a061-41a6-bb58-c3ea8c6ed16f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:20.577149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 88/177] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:20 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=225a6a8e2a18462b9dbdc635d2bdde91&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:20.577149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.577149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.577149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.602185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:20.603341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:20.616368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:20.682618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 89/178] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:20.702115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d557d85-b632-4dc2-a37c-b3f0aebcdc5d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.753931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.754578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.754856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.755132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] PATH_INFO: `/v3/users/46d6f6c7d946446f809757021f629631` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.756327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] RBAC: Authorizing `identity:get_user(user_id=46d6f6c7d946446f809757021f629631)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:20.757778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ed975-3522-47f5-b681-fa87fe999f56 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:20.759386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 90/179] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:20 2022] GET /identity/v3/users/46d6f6c7d946446f809757021f629631 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:20.766120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:20.886937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee2183-05ad-4bb8-9520-18c03fea1738 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.887281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee2183-05ad-4bb8-9520-18c03fea1738 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.887474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee2183-05ad-4bb8-9520-18c03fea1738 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.890670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 91/180] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:20.895052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.895333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.895604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:20.910697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4970-f882-4be1-b4f0-38e38d754a6b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:20.927927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:20.929120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:20.968070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:20.968606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:20.968883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:20.969147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.000279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.014362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 92/181] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:21.081635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.086791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.088629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.094890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.196065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe112f0-9b24-41f1-86ad-c535bd8c460e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.235102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.235102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.235102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.235102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.253859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:21.258744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:21.259662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:21.260528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:21.262738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 93/182] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:21.269674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.289397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 90/183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:21.295393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.363306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.381883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.413317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bb65-655c-4368-9e8b-6b72841bbba7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.429147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0ba2-3af4-4373-a9ec-4afd31142f05 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.450925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.451938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.451938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.452207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.452878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:21.453176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.454555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.462661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 94/184] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:21.463462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.467184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.468281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.468500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.468761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.469893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.471317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeafeca-0e2d-499e-bcd0-d00a57516a2b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.472961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 91/185] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:21.474188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b8c9-bc0a-42fe-8712-fc80f623e301 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.474466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b8c9-bc0a-42fe-8712-fc80f623e301 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.474736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b8c9-bc0a-42fe-8712-fc80f623e301 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.476381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 92/186] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:21.476960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b8c9-bc0a-42fe-8712-fc80f623e301 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.574108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe330bb-bf65-450b-bb8c-d0a6078030f1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.584674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b8c9-bc0a-42fe-8712-fc80f623e301 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.595873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.603914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.609277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.610007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.610286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.610558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.618787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.619397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.619670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.619971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.621023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:21.626895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:21.627808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:21.628619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 95/187] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:21.629356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.636391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.638382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1509f-543e-448d-8526-90a5a6d74685 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.640071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 93/188] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:21.644754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a043-93dc-4fd3-8a69-3814fddc50cf None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.644754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a043-93dc-4fd3-8a69-3814fddc50cf None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.644754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a043-93dc-4fd3-8a69-3814fddc50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.659859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f293a043-93dc-4fd3-8a69-3814fddc50cf None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:21.661021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f293a043-93dc-4fd3-8a69-3814fddc50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:21.728455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 94/189] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:21.729684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf8b-e6c4-4998-b019-fbb7134d8ecf None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.729978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf8b-e6c4-4998-b019-fbb7134d8ecf None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.730250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf8b-e6c4-4998-b019-fbb7134d8ecf None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.735633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 95/190] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:21.735633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fdf8b-e6c4-4998-b019-fbb7134d8ecf None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.737702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0a37-31a1-43c8-9b92-f7ba1258a7dd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.775127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.775888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.776170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.776439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.777286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=46d6f6c7d946446f809757021f629631) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:21.777588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.780276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.786668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 96/191] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/role_assignments?user.id=46d6f6c7d946446f809757021f629631&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=040e823c6d874b98830778582091d28a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:21.787377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:21.860848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.869552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.876298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fdf8b-e6c4-4998-b019-fbb7134d8ecf None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.918577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.920445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.920945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.921407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.921698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75300d2f-262d-4148-a30e-2698f395e78a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:21.922490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:21.923003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:21.924839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc4f04-91f2-4dc2-99ea-cd51ab78199d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:21.934334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 96/192] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:21.941277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.941761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.942238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:21.967841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:21.968772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:21.969824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:21.970448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:21.970785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:21.971000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.047309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 97/193] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:22.048468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.055602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.057150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.116814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.148005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.158561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f41b9-8c73-4cb3-99fb-01b9ccbbf18c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.163007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 97/194] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:22.166548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.196715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.197334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.197608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.197930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.199188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.201693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.202577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 98/195] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:22.203330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.269486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692ea-dff7-4010-827d-52911fba50e9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.305630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.306261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.306546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.306831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.310119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.310119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.311677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 98/196] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:22.312275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.332044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca697fb-3e32-4f41-b858-ca92711772ae None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.338195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.367225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.367770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.368075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.368343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.369461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.370902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.373012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 99/197] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:22.373764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.402033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.420452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa87a4-0fef-444f-b984-2d05707c9427 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.454350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.454942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.455216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.455479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.473661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062f5c6-d4d5-4d6a-93f2-19fb39408078 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.506583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.507271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.507545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.507828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.508460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.509890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.522797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.524298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.548214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.621666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 99/198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:22.623078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.639598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 100/199] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:22 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:22.639598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.728459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.743299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a157a83-204b-4cf9-89a7-47d3d69e3179 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.748690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0133c0-afe2-4f61-87f9-25f12cd75d0b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.774920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:22.786970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.787887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.788019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.788019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.788255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.788339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.788859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.789616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.791345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=e38c10093008414d89fe303b6259bab9) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:22.793234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.794822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:22.801782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 101/200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/role_assignments?user.id=e38c10093008414d89fe303b6259bab9&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:22.802675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.804401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:22.811529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:22.812876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:22.813682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:22.815589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 100/201] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:22.822895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:22.943698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b9a9-a224-4b3d-bd00-42304654d577 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.959753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8034387-9e58-4e90-886f-28c7d46330d1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:22.994374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:22.995004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:22.995284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:22.995663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:22.996962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:22.998487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.000499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 102/202] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:23.005886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:23.006476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:23.006757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:23.006857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:23.007034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:23.007711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:23.008076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:23.009468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.022693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 101/203] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:23.030368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:23.034835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:23.093815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:23.144852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f4db-6ad0-4416-894b-4bd80864569a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:23.168048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f192-80b1-4528-8254-3b9566547209 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:23.191927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:23.193656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:23.194114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:23.194395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:23.195594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=e38c10093008414d89fe303b6259bab9) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:23.195594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:23.197215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.207812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 103/204] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:23 2022] GET /identity/v3/role_assignments?user.id=e38c10093008414d89fe303b6259bab9&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=040e823c6d874b98830778582091d28a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:23.234754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:23.235407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:23.235685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:23.235979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] PATH_INFO: `/v3/users/7c896a3f38944794bd69387917f623b9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:23.240650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] RBAC: Authorizing `identity:get_user(user_id=7c896a3f38944794bd69387917f623b9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:23.242136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.244210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 102/205] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:23 2022] GET /identity/v3/users/7c896a3f38944794bd69387917f623b9 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:23.249858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:23.375058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:23.397527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec7af-40f5-49ac-9ee9-b70cf8676a91 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:23.442953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:23.443578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:23.443876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:23.444196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:23.519237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:23.520720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.624522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:23.655834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 104/206] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:23.661671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:23.866652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f2fe-9925-4881-885e-372d16662b9a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:23.886457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:23.911542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:23.912199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:23.912474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:23.912778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:23.913914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:23.915361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89191-0d80-453d-9a5e-51f3bf33f6b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:23.917431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 103/207] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:23 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:23.923421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:24.082448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2143d-6108-4608-ae2d-4a4eac2cdc61 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:24.123966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:24.124491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:24.124766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:24.125030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:24.125743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, scope.project.id=f32a052fd52b4cee853607ca12e9565d, user.id=7c896a3f38944794bd69387917f623b9) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:24.126045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:24.127487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aad3b9-3101-44b9-afe3-d9a5ff69b6c6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:24.134212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 105/208] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:23 2022] GET /identity/v3/role_assignments?user.id=7c896a3f38944794bd69387917f623b9&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=01d728abd8844cb394ddaa2629c81871 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:24.916133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aed94-2c88-45a8-8d90-fd814d43c621 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:24.917197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aed94-2c88-45a8-8d90-fd814d43c621 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:24.917699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aed94-2c88-45a8-8d90-fd814d43c621 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:24.919562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 104/209] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:24.925282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:24.926091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:24.926574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:24.950803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:24.952642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:24.996808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:25.017754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a0d6-1ca5-4860-b558-d0d292393028 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.018371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a0d6-1ca5-4860-b558-d0d292393028 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.018840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a0d6-1ca5-4860-b558-d0d292393028 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.024704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 105/210] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:25.026176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12204-3c9c-460a-851b-611363ec3e27 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.026653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12204-3c9c-460a-851b-611363ec3e27 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.027116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12204-3c9c-460a-851b-611363ec3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.034284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 106/211] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:25.048037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e5f12204-3c9c-460a-851b-611363ec3e27 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:25.049479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e5f12204-3c9c-460a-851b-611363ec3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:25.119049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 106/212] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:25.316742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.340485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d609d-5c63-4558-856c-efb2cbaccbc6 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.341753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d609d-5c63-4558-856c-efb2cbaccbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.342236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d609d-5c63-4558-856c-efb2cbaccbc6 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.343774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 107/213] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:25.349144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.349660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.350417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.369220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:25.370717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:25.430700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017213b-b48f-4fdc-9766-7fa89086031c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.442812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 108/214] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:25.448291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.474414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.475665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.476202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.476661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.489177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:25.490278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:25.496190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:25.498022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:25.498802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:25.500931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 107/215] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:25.506547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.547234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:25.560700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfccb0-2888-47b1-a2c8-e63b5a75101d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.594235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.594885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.595162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.601448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.607019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f495779b-1f88-4c89-bb85-59a555c1794c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:25.611977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:25.612854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:25.613623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 109/216] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:25.614891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bee6-0a83-459b-aa4f-8d89cfea2895 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.614891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bee6-0a83-459b-aa4f-8d89cfea2895 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.614891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935bee6-0a83-459b-aa4f-8d89cfea2895 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.616186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 110/217] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:25.619268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935bee6-0a83-459b-aa4f-8d89cfea2895 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.628220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7cc1-61a6-4a33-8aca-4069f43d43d5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.687569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.688200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.688548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.688828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.689496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:25.689797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:25.691191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25790-1819-4664-9cbb-aed1e3b4c668 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:25.699432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 108/218] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:25.704237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.704237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.704237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.719735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:25.720944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:25.759138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935bee6-0a83-459b-aa4f-8d89cfea2895 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.760626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:25.786845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 109/219] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:25.787689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.806152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.806752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.807025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.807289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.807968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:25.808266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:25.810132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:25.813322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:25.818326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 111/220] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:25.819033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.898352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c816-70a0-488a-bddf-850d27bc5847 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.933239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.933841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b23009-d3ad-4b9a-ad67-c8c6d20841ce None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:25.934228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.934228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.935009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] PATH_INFO: `/v3/users/9372230bc83640e6aca096188c240665` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.948877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=9372230bc83640e6aca096188c240665)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:25.951895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:25.954695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 110/221] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/users/9372230bc83640e6aca096188c240665 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:25.955739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:25.971428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:25.972086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:25.972379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:25.972640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:25.973740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:25.975438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:25.977181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 112/222] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:25.977795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.009613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.053294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.071265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8974f-3213-4cb4-bab6-26ff733bd8b9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.084325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22508d-e09d-4384-91cb-cbf1cf169013 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.106320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.106947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.107220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.107485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.108631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.110068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.111630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 111/223] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:26.116325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.119163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.119765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.120071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.120338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.188518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.189976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.214495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8efe-9938-490e-9d16-3cc92e460f24 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.220205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.249569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.250171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.250446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.250717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.251370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.252846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.290552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 113/224] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:26.291465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.366467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 112/225] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:26 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:26.368702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.379285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.394835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1f5c-d81c-4910-a223-c4617e1967c5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.428739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.434243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.435403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.435688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.436029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.448951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:26.454476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:26.455600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 114/226] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:26.461738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.489738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0429b94-dc7f-499c-a412-720bed88c8d3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.532938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.533817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.534091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.534357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.535860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.537303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.539104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 113/227] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:26.539769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.572033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c25a6-9e9b-42c9-922e-bb419056fd2d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.614006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.614748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.615090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.615429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.622719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.622719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.622719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 115/228] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:26.622719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.650323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.678000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a8e10-6d94-4625-b065-8a3865d6b989 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.701616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.724047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.724658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.724934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.725465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.726574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:26.726874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.728636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.739737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 114/229] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:26.744863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.758763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4303-554f-467b-9836-7ae22bc3574e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.796525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.797188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.797467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.797736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/e38c10093008414d89fe303b6259bab9/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.799897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, user_id=e38c10093008414d89fe303b6259bab9, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.801422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.860316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe190d7-53dd-478b-b35d-d5c87bf16232 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:26.886097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 116/230] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:26 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/e38c10093008414d89fe303b6259bab9/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:26.891868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:26.920556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:26.921170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:26.921442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:26.921707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:26.922476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=9372230bc83640e6aca096188c240665) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:26.922741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:26.924269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:26.929070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:26.936165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 115/231] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/role_assignments?user.id=9372230bc83640e6aca096188c240665&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:27.068606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95797b-07c7-4bbe-8c46-0d579af042cf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:27.093003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:27.110212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:27.110862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:27.111141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:27.111495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:27.112695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:27.114238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:27.116013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 117/232] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:26 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:27.123580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:27.244879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36e485-31d7-45bc-9436-147c9ea4959b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:27.293388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:27.297745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:27.297745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:27.297745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:27.300026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:27.300659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc656f9-c22c-4034-8ad2-8559fcee9ffe None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:27.302369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 116/233] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:27 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:27.308645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:27.462543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7315af-07e0-4a28-a5fc-c6bf51af1008 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:27.511647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:27.512353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:27.513247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:27.513518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/e38c10093008414d89fe303b6259bab9/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:27.516045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, user_id=e38c10093008414d89fe303b6259bab9, role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:27.517500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5925d1-4e0d-489a-b2a3-39c3736c3038 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:27.652240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 118/234] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:27 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/e38c10093008414d89fe303b6259bab9/roles/040e823c6d874b98830778582091d28a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:28.674694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633f3c-ad44-4ff0-9d02-a565d3f9b352 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:28.675188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633f3c-ad44-4ff0-9d02-a565d3f9b352 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:28.675470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633f3c-ad44-4ff0-9d02-a565d3f9b352 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:28.676707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 117/235] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:28.690127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faa6b-1466-4f24-a0d0-a510a35ce0c0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:28.690595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faa6b-1466-4f24-a0d0-a510a35ce0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:28.690668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faa6b-1466-4f24-a0d0-a510a35ce0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:28.716131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3a6faa6b-1466-4f24-a0d0-a510a35ce0c0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:28.717510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3a6faa6b-1466-4f24-a0d0-a510a35ce0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:28.777323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:28.807699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 119/236] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:28.829959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f160d8-68de-498a-b875-a01eb9598510 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:28.830258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f160d8-68de-498a-b875-a01eb9598510 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:28.830511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f160d8-68de-498a-b875-a01eb9598510 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:28.831966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 118/237] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:28.837327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:28.837618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:28.837891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:28.858706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:28.859925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:28.947150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 120/238] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:29.229196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f160d8-68de-498a-b875-a01eb9598510 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.250801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.333092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.366638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1296-0a69-4ef3-ae6c-c03244f625d0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:29.375073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f160d8-68de-498a-b875-a01eb9598510 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:29.379350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.410024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:29.410699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.410977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.411256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.413976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:29.414824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.415266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.415675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.416965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:29.419502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4464-87a8-4536-963a-9c7070409ee9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:29.426037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 119/239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:29.426201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:29.427623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e1bb-52cc-42d4-a64c-f8c9c641b868 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.428077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e1bb-52cc-42d4-a64c-f8c9c641b868 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:29.428186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:29.429197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 121/240] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:29.430016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.431473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e1bb-52cc-42d4-a64c-f8c9c641b868 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.432964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 120/241] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:29.434944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e1bb-52cc-42d4-a64c-f8c9c641b868 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.538432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c015d-d2f0-4582-8a0a-79d2d9daab6e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:29.550518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e1bb-52cc-42d4-a64c-f8c9c641b868 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:29.573483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:29.574089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.574359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.574622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.575291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:29.576768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c702f-3d49-4106-b42d-7d960149b9be None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:29.587543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:29.588181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.588474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.588725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.589408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:29.589705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:29.591819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72528d-1241-419c-8173-018f16800d8a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:29.597261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.601347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 121/242] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:29.602346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45ddf-60bd-4125-bf4c-aaa6a6b1ae64 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.602627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45ddf-60bd-4125-bf4c-aaa6a6b1ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.602896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45ddf-60bd-4125-bf4c-aaa6a6b1ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.620742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4ab45ddf-60bd-4125-bf4c-aaa6a6b1ae64 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:29.622007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4ab45ddf-60bd-4125-bf4c-aaa6a6b1ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:29.688342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 122/243] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:29.689296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a81b3-664c-4930-9c4a-3f8dde6b48b7 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.689581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a81b3-664c-4930-9c4a-3f8dde6b48b7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.689862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a81b3-664c-4930-9c4a-3f8dde6b48b7 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.691248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 123/244] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:29.692596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a81b3-664c-4930-9c4a-3f8dde6b48b7 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.768195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 122/245] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:29 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:29.770277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.770739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.771206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.807189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:29.810745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:29.838496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a81b3-664c-4930-9c4a-3f8dde6b48b7 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:29.856856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.888379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.910295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:29.910935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:29.911209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:29.911472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] PATH_INFO: `/v3/users/d6fa9795792e416a9b1f88303627121d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:29.938415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] RBAC: Authorizing `identity:get_user(user_id=d6fa9795792e416a9b1f88303627121d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:29.939940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:29.941653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 124/246] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/users/d6fa9795792e416a9b1f88303627121d => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:29.947356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:29.964518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 123/247] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:29.976939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.071656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e9aa-a263-4cc7-b5c6-333f373255a7 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.102385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093694c-6040-4ad5-bb25-2d88bb899361 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.117358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.118140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.118543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.118918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.146159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.147024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.147701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.148158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.167502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e759d649-4d01-4deb-8e43-8ec97f5cec8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:30.173306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:30.174197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:30.174997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 124/248] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:30.175724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2bea-5ea3-412b-9611-4ce44fe75317 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.176325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2bea-5ea3-412b-9611-4ce44fe75317 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.176325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2bea-5ea3-412b-9611-4ce44fe75317 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.177640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 125/249] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:30.183366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.183762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.184060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.200595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.203380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:30.205500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:30.217543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.218348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:30.220056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:30.314315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 126/250] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:30.315455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.373139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 125/251] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:30.374361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.464183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d53e69-3c9e-47b0-8960-63ed3b5e4c44 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.475429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.493254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e633-7ddd-4661-9280-1d37bbb417c3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.519192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.519822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.520101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.520372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.521047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:30.521347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:30.525512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:30.539860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 127/252] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:30.540706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.553405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.554041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.554314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.554582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.561154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.574010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:30.580040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:30.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:30.581731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:30.583544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 126/253] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:30.589617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.690177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae9bbd-b36d-4a73-9f6b-15e3697c0fbb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.729487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.730222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.730559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.730829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.732221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:30.733593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d9221-4001-4753-b6ad-c3032685e04c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.734096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:30.735637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 128/254] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:30.741052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.784402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.785319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.785602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.786874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] PATH_INFO: `/v3/users/9372230bc83640e6aca096188c240665` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.788064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] RBAC: Authorizing `identity:get_user(user_id=9372230bc83640e6aca096188c240665)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:30.789538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:30.791747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 127/255] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/users/9372230bc83640e6aca096188c240665 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:30.792541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.815297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.838015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:30.866479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd94d5e-ee42-4a57-b61e-f1e37cae1187 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.913305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.914155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.915055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.915508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.916638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:30.917245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:30.920302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:30.927071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe2d5-8629-447c-8ab5-f973ebb3bf81 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:30.937540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 129/256] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:30.937540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:30.976040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:30.977265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:30.978647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:30.979147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:30.993880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:31.001669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:31.002580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:31.003374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:31.009261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 128/257] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:31.009261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.058167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8497c-31bb-48c3-a9e3-9ecaddda044e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.103418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.104470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.105177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.105557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.105932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.108177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=d6fa9795792e416a9b1f88303627121d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:31.108640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.110508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.115814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.118144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 130/258] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:30 2022] GET /identity/v3/role_assignments?user.id=d6fa9795792e416a9b1f88303627121d&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=01d728abd8844cb394ddaa2629c81871 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:31.123821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.155893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa7168-f122-4db6-83de-75d7b7b356c1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.239070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.240141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.240726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.241201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.242569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.252746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.255439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 129/259] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:31.256502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.298179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff55b8-e94b-4480-9668-9221e76fbc1c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.343206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.343891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.344172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.344449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.346553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.348048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.349676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 131/260] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:31.350697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.407373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21b490-c9f2-49a4-a69a-34690aef5814 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.472234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.473380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.476528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.476812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.477507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:31.477818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.479220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.489346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 130/261] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:31.489892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.490118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.500384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.553088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b99d-b8db-4f31-96a5-85e7961c9968 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.619517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.620213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.620486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.620756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/9372230bc83640e6aca096188c240665/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.624589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, user_id=9372230bc83640e6aca096188c240665, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.626026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.662042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed0291-6b4d-4041-bbea-aab7128ce3be None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.696582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.697284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.697561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.697823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.722436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 132/262] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:31 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/9372230bc83640e6aca096188c240665/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:31.723056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:31.815090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.821558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.839840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.844891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b7c1-9e25-4bda-8e1a-fe754b8f3f45 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:31.875284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:31.883753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:31.884537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:31.885068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:31.885068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] PATH_INFO: `/v3/users/e38c10093008414d89fe303b6259bab9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:31.886363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] RBAC: Authorizing `identity:get_user(user_id=e38c10093008414d89fe303b6259bab9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:31.888181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:31.890257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 133/263] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/users/e38c10093008414d89fe303b6259bab9 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:31.895891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:32.026542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939470f2-cb89-4983-948d-db518b776d74 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:32.069632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:32.070373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.070652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.070919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.090825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 131/264] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:32.117515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:32.148205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:32.150648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:32.152373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:32.261207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 134/265] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:32.267549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:32.388608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:32.400214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae0a1-e8f0-4566-8640-aadc242b571b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:32.460730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:32.461381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.461658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.461928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.463345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:32.464851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:32.467343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 135/266] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:32 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:32.473299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:32.540210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4705-e134-4187-b5b3-0377f12d7146 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:32.542857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:32.591229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:32.592085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.592418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.592698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.595561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:32.597066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f274-251b-43d2-9079-8039e65b4e2f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:32.600615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 132/267] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:32 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:32.601812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159210-9b79-4549-a4a4-af4cd759cbac None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.602093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159210-9b79-4549-a4a4-af4cd759cbac None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.602369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159210-9b79-4549-a4a4-af4cd759cbac None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.606464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 133/268] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:32.607408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14159210-9b79-4549-a4a4-af4cd759cbac None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:32.640174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0dd5d-b573-4bd3-a31a-29252e448bc4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:32.680325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:32.680962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.681240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.681509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.682230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=e38c10093008414d89fe303b6259bab9) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:32.682536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:32.684052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b95a8d-b8fe-49ba-9104-7e1db46f5e26 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:32.692011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 136/269] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:32 2022] GET /identity/v3/role_assignments?user.id=e38c10093008414d89fe303b6259bab9&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=040e823c6d874b98830778582091d28a => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:32.693177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6612d2-95e5-44c1-a80d-82a71d865afb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.693519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6612d2-95e5-44c1-a80d-82a71d865afb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.693796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6612d2-95e5-44c1-a80d-82a71d865afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.714384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-da6612d2-95e5-44c1-a80d-82a71d865afb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:32.715742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-da6612d2-95e5-44c1-a80d-82a71d865afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:32.747471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:32.819003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 137/270] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:32.820850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944da94-3dd1-4bd4-b3b5-a318df6889ad None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.821200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944da94-3dd1-4bd4-b3b5-a318df6889ad None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.821471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944da94-3dd1-4bd4-b3b5-a318df6889ad None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.822964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 138/271] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:32.828582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.829091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.829363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.844527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14159210-9b79-4549-a4a4-af4cd759cbac None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:32.850799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:32.852069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:32.911902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:32.912449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:32.912727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:32.913601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:32.914332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=e38c10093008414d89fe303b6259bab9) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:32.914638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:32.916110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:32.931515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 134/272] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:32 2022] GET /identity/v3/role_assignments?user.id=e38c10093008414d89fe303b6259bab9&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:32.963060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 139/273] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:33.246577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.285319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:33.363008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.384421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c0eea-9127-4912-b1ca-dd641a462895 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:33.429348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:33.430278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.430557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.430829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.446710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:33.454016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:33.456055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:33.457406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 135/274] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:33.464816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.474794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:33.490367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afb8db-5319-4983-9790-2e8217e4821d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:33.536809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:33.537376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.537808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.538087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.539266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:33.540743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:33.542452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 140/275] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:33.548385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.596782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:33.601368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d494-f2c2-4ef0-9fe8-e31631de7a3b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:33.637877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:33.638581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.638857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.639184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.639883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:33.644994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:33.644994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648729-554e-4f5f-87ea-cda5ed5d9b97 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:33.658190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 136/276] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:33.658190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9797a-8814-4703-be49-7a7eb9590eab None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.658190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9797a-8814-4703-be49-7a7eb9590eab None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.658190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9797a-8814-4703-be49-7a7eb9590eab None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.658190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 137/277] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:33.660317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9797a-8814-4703-be49-7a7eb9590eab None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.662507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499b3dc-e13b-4939-89e8-9f53830c1a3c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:33.696143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:33.696746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.697022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.697287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.697929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:33.699373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540b074-486a-4501-859f-1eb2b9b70c29 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:33.769889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9797a-8814-4703-be49-7a7eb9590eab None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:33.779439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 141/278] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:20:33 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:20:33.780721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.781035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.781308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.804320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:33.805930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:33.817676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:33.822115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:33.822759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:33.823031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:33.823322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] PATH_INFO: `/v3/users/351a95747ffe4180bfb99c2bbb18e5ab` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:33.842077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] RBAC: Authorizing `identity:get_user(user_id=351a95747ffe4180bfb99c2bbb18e5ab)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:33.843597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:33.850898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 138/279] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:33 2022] GET /identity/v3/users/351a95747ffe4180bfb99c2bbb18e5ab => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:33.852777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:33.875858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:33.905042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 142/280] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:33.973249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c1b58-6273-401b-ac7d-b5b1c0c0d4df None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:34.011003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:34.011609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.011988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.012255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.013596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, user.id=351a95747ffe4180bfb99c2bbb18e5ab, scope.system=all) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:34.013897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:34.015376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98f91-2c80-48b4-aa80-5e50dd6b5600 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:34.020990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 139/281] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 24 10:20:33 2022] GET /identity/v3/role_assignments?user.id=351a95747ffe4180bfb99c2bbb18e5ab&scope.system=all&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:34.175527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:34.239116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c24b-1c2f-4129-9eb4-6809e986b228 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.239453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c24b-1c2f-4129-9eb4-6809e986b228 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.239656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c24b-1c2f-4129-9eb4-6809e986b228 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.241269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 140/282] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:34.246483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.246803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.247075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.265905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:34.267069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:34.312019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fae823-7868-49cb-9e25-e43553c3c7d6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:34.347507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 141/283] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:34.385837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:34.386474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.386750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.387021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.404667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:34.409438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:34.410309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:34.411095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 143/284] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:34.416386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:34.429667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:34.524119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f59f6-a0eb-4cd5-9c48-a2f11ac2427d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:34.561212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:34.561827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.562106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.562378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.563049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:34.563351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:34.564768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:34.573641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 142/285] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:34.579307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:34.582730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:34.693458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a093b5-f306-4f06-8b6a-2c77ef0d1fc2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:34.744431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:34.745058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:34.745335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:34.745604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] PATH_INFO: `/v3/users/d6fa9795792e416a9b1f88303627121d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:34.746788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] RBAC: Authorizing `identity:get_user(user_id=d6fa9795792e416a9b1f88303627121d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:34.748315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:34.754131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 144/286] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:34 2022] GET /identity/v3/users/d6fa9795792e416a9b1f88303627121d => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:34.755418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:34.774824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:34.881402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:34.911715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:34.941212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855612a-c6d9-4bc2-ac4a-78c7703c529d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:34.966454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d88bc1-a40e-477b-8654-3de0ff99b42f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.016503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.017144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.017425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.017693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.020367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.021197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.021663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.022121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.023264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.024745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.026390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 143/287] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:34 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:35.032787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:35.035733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:35.041181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:35.042046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:35.042828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:35.046932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 145/288] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:35.052266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:35.154528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e0f5-4c2a-4834-9b97-75b89eacbb44 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.194858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:35.216356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.217090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.217314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.217576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.218245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:35.218539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.219949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.220909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23e80e-c4a6-43aa-a8d5-b51742435328 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.251424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 146/289] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:35.257149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:35.268524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.269207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.269487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.269758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/d6fa9795792e416a9b1f88303627121d/roles/01d728abd8844cb394ddaa2629c81871` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.271899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, user_id=d6fa9795792e416a9b1f88303627121d, role_id=01d728abd8844cb394ddaa2629c81871)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.273457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.373472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:35.379077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a781-8dfc-4268-9e93-4816ab4b7168 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.386705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 144/290] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:20:35 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/users/d6fa9795792e416a9b1f88303627121d/roles/01d728abd8844cb394ddaa2629c81871 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:20:35.419727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.420382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.420671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.420982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] PATH_INFO: `/v3/users/9372230bc83640e6aca096188c240665` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.422211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] RBAC: Authorizing `identity:get_user(user_id=9372230bc83640e6aca096188c240665)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.423763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.430293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 147/291] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:35 2022] GET /identity/v3/users/9372230bc83640e6aca096188c240665 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:35.431944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:35.585319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5c9-aa2f-4c9c-89e1-8d360dd0c6cc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.622303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.622915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.623250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.623525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.694364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:35.697331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.698855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.818042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 145/292] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:35.823843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:35.886365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:35.929115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3dc3-ca7a-473b-9740-db2452a4db0c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:35.964141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:35.964769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:35.965044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:35.965318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:35.967106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:35.968572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c6da5-ce5f-4f64-88d9-ee19aedb6941 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:35.975379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 148/293] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:35 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:35.976801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:36.091234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:36.094568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09da9-f157-476c-8ee4-33543eeb7921 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:36.129953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:36.130876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.131295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.131719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.132620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=9372230bc83640e6aca096188c240665) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:36.133065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:36.134667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f7873-af3c-4116-86aa-a7338545af79 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:36.147988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 146/294] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:35 2022] GET /identity/v3/role_assignments?user.id=9372230bc83640e6aca096188c240665&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:36.299070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652b168-7cfb-47ad-ad4d-55815ed29357 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.302157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652b168-7cfb-47ad-ad4d-55815ed29357 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.302646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652b168-7cfb-47ad-ad4d-55815ed29357 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.304611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 149/295] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:36.310427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a805-12f0-440e-8f3b-2d2cdae94744 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.310710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a805-12f0-440e-8f3b-2d2cdae94744 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.310983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473a805-12f0-440e-8f3b-2d2cdae94744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.337429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b473a805-12f0-440e-8f3b-2d2cdae94744 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:36.338620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b473a805-12f0-440e-8f3b-2d2cdae94744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:36.416963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 147/296] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:36.431135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525528-033b-44f2-8be4-447f540b219c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.431698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525528-033b-44f2-8be4-447f540b219c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.432220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28525528-033b-44f2-8be4-447f540b219c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.433765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 150/297] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:36.439739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81e7f-a88e-4441-a16c-1e49f309b00e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.440304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81e7f-a88e-4441-a16c-1e49f309b00e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.440772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe81e7f-a88e-4441-a16c-1e49f309b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.461765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fbe81e7f-a88e-4441-a16c-1e49f309b00e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:36.463307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fbe81e7f-a88e-4441-a16c-1e49f309b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:36.547721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 148/298] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:36.551776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fdb6-656b-4985-989b-116b6d34c895 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.552100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fdb6-656b-4985-989b-116b6d34c895 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.552373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fdb6-656b-4985-989b-116b6d34c895 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.553815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 151/299] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:36.558667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.559799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.560291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.582763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:36.584282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:36.608059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:36.660976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 149/300] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:36.721859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94fdb6-656b-4985-989b-116b6d34c895 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:36.825900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:36.827836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94fdb6-656b-4985-989b-116b6d34c895 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:36.854995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:36.863385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:36.864011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.864286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.864552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.881228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:36.887372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:36.888531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:36.889349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:36.891873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 152/301] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:36.895612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:36.951945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aad3b-fdcb-40c4-bbdb-71e77e7b789e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:36.991795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:36.993055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:36.993419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:36.993593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:36.994677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:36.996120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:36.997880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 150/302] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:37.000637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.013576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94694c-3545-43a1-80e6-d7cfbdeb43d1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.033780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.049032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.049628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.049900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.050165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.050816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:37.051111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.052479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.060379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 153/303] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:37.061145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.111722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.121010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce202515-15ee-44e1-813a-222d81690abd None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.158798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.159761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.160202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.160641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.162159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ac63-dcbf-498a-aaa9-ce0e8eba9f07 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.172310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:37.177566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:37.178609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:37.179572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:37.181869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 151/304] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:37.182848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.202197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.203023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.203442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.203933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] PATH_INFO: `/v3/groups` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.204687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.206259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.265731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.283899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f1af5-8200-4eaf-89c8-2e2f8af3ecec None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.292621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 154/305] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Aug 24 10:20:37 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:20:37.300959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.327643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.328302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.328578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.328841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] PATH_INFO: `/v3/users/7fdb281b296d4057931005d191f623ab` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.347842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] RBAC: Authorizing `identity:get_user(user_id=7fdb281b296d4057931005d191f623ab)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.349358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.351650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 152/306] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:37 2022] GET /identity/v3/users/7fdb281b296d4057931005d191f623ab => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:37.357554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.446146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf5850-6280-42ba-af1d-bed810680d07 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.459402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.492115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.492746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.493207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.493640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.494398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:37.494654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.496154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.508183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 155/307] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:37.514592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.518374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac84c7-a194-43c0-914a-691117746a72 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.563031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.563643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.563955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.564228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.564958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, user.id=7fdb281b296d4057931005d191f623ab, scope.system=all) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:37.565264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.566882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.573003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 153/308] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 24 10:20:37 2022] GET /identity/v3/role_assignments?user.id=7fdb281b296d4057931005d191f623ab&scope.system=all&role.id=01d728abd8844cb394ddaa2629c81871 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:37.650481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3f10c-4960-48ed-83a0-379a5c66071b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.692842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.693488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.693768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.694040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] PATH_INFO: `/v3/users/351a95747ffe4180bfb99c2bbb18e5ab` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.695234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=351a95747ffe4180bfb99c2bbb18e5ab)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.696794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417b64-5e73-4076-be6a-14ae24d1b0e5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.698809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 156/309] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:37 2022] GET /identity/v3/users/351a95747ffe4180bfb99c2bbb18e5ab => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:37.704922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:37.709341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.747072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371f4c-a493-46d7-90d0-a8ed2455516d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.747570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371f4c-a493-46d7-90d0-a8ed2455516d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.747980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371f4c-a493-46d7-90d0-a8ed2455516d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.749378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 157/310] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:37.754849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.755138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.755413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.773874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:37.774987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:37.813632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.853464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 158/311] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:37.869511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f5f7-aa45-4e3f-a873-256a452dd7ce None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:37.904390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:37.905368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:37.905853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:37.906312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] PATH_INFO: `/v3/system/users/351a95747ffe4180bfb99c2bbb18e5ab/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:37.907970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=351a95747ffe4180bfb99c2bbb18e5ab, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:37.909555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:37.995246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 154/312] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Aug 24 10:20:37 2022] PUT /identity/v3/system/users/351a95747ffe4180bfb99c2bbb18e5ab/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:38.139475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:38.245166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63e35-1987-495c-9d17-5ac13116ef67 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:38.283344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:38.284047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:38.284276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:38.284544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:38.313526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:38.318473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:38.319345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:38.324566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 159/313] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:38.331356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:38.442652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:38.486689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c39e2-0e82-4f20-8ced-992d7b4be8a9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:38.530372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:38.531074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:38.531356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:38.531627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:38.532326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:38.532627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:38.533997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:38.542778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 155/314] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:38.550020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:38.603107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:38.750147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382d2d-3725-4833-8ed3-57a52437d483 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:38.816730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:38.817377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:38.817653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:38.817919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] PATH_INFO: `/v3/users/d6fa9795792e416a9b1f88303627121d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:38.821636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=d6fa9795792e416a9b1f88303627121d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:38.823082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:38.825214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 160/315] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:38 2022] GET /identity/v3/users/d6fa9795792e416a9b1f88303627121d => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:38.831563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:38.959933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8e92-8c75-4a19-9de5-4512ffdf4da3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:39.003891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:39.004502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.004750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.004982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.008041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:39.104405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:39.105880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c9dc-3e09-4e49-ba88-926949a4faa5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:39.210455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 156/316] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:39.217213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:39.325557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc5d20-b598-452a-be18-7b70588b988e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.325818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc5d20-b598-452a-be18-7b70588b988e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.326092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc5d20-b598-452a-be18-7b70588b988e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.327823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 157/317] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:39.333222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc401b8-7882-43e6-8964-574e4ea43e1e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.333752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc401b8-7882-43e6-8964-574e4ea43e1e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.334031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc401b8-7882-43e6-8964-574e4ea43e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.336136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:39.341627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f217-71ca-44f7-ad30-fe5ecf7c1ae5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:39.356006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7dc401b8-7882-43e6-8964-574e4ea43e1e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:39.362020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7dc401b8-7882-43e6-8964-574e4ea43e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:39.382211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:39.383093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.383518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.384007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.385336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:39.386914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:39.387226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:39.389310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 161/318] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:39 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:39.395246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:39.451867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 158/319] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:39.509755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59aa3-a360-413d-b801-e4e1456cbf31 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:39.545298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:39.546173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.546616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.547077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.548008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73, user.id=d6fa9795792e416a9b1f88303627121d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:39.548484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:39.550124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d5c92-ebd6-41ba-b8d1-901e3df06542 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:39.556927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 162/320] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:20:39 2022] GET /identity/v3/role_assignments?user.id=d6fa9795792e416a9b1f88303627121d&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=01d728abd8844cb394ddaa2629c81871 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:39.705805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491aff-b57b-45a9-895b-e61474177863 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.706158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491aff-b57b-45a9-895b-e61474177863 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.706438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491aff-b57b-45a9-895b-e61474177863 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.708078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 159/321] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:39.713256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.713539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.713812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.733036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:39.734288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:39.748984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491aff-b57b-45a9-895b-e61474177863 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:39.760003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:39.816935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 163/322] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:39.870907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491aff-b57b-45a9-895b-e61474177863 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:39.906227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:39.906852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:39.907128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:39.907396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:39.908516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:39.909957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:39.911729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 160/323] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:39.917029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.018770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8254a8-b29a-4148-9b82-b50d8d7363bd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.053737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.054336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.054612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.054881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] PATH_INFO: `/v3/groups` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.055499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:40.056981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad04cfe-cb35-4a7f-8f44-b4d9b31d1da1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:40.086609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.117840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.165012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 164/324] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Aug 24 10:20:39 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:20:40.166240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff771-2619-4566-9f40-4235ed9be002 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.166520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff771-2619-4566-9f40-4235ed9be002 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.166784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff771-2619-4566-9f40-4235ed9be002 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.168228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 165/325] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:40.174666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.174986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.175220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.194008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:40.194211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7daa4-208d-45de-88e6-559aba44a9f2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.195212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:40.210970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.235292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.236231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.236500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.236765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.249915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:40.254751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:40.259950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:40.261200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 161/326] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:40.263384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.275093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 166/327] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:40.366102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.377444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f8741-a99f-429d-8038-60d236a97722 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.415218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.415842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.416409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.416409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.417086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:40.417386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:40.419237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:40.428737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 162/328] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:40.434247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.541450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ba86d-9922-4ae7-9912-0375ac035ab8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.556385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.589494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.591093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.591370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.591643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] PATH_INFO: `/v3/users/7fdb281b296d4057931005d191f623ab` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.594893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] RBAC: Authorizing `identity:get_user(user_id=7fdb281b296d4057931005d191f623ab)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:40.596295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:40.597803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 167/329] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/users/7fdb281b296d4057931005d191f623ab => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:40.607815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.634340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.697364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f3bff-2c5f-4be2-a364-ccc931d7ec08 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.732006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bfc39-2b9b-4e3d-8c81-272f01c6a933 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.748564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.749580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.750056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.750532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.763682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:40.769301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:40.770235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:40.771030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:40.772200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 163/330] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:40.772668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.773319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.773589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.773852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] PATH_INFO: `/v3/system/users/7fdb281b296d4057931005d191f623ab/roles/01d728abd8844cb394ddaa2629c81871` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.776557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7fdb281b296d4057931005d191f623ab, role_id=01d728abd8844cb394ddaa2629c81871)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:40.778293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:40.781121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:40.795917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:40.853187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 168/331] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Aug 24 10:20:40 2022] PUT /identity/v3/system/users/7fdb281b296d4057931005d191f623ab/roles/01d728abd8844cb394ddaa2629c81871 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:20:40.899666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd83ba-7ca7-4b9d-9213-aef25f805388 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:40.944657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:40.945333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:40.945618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:40.945932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:40.946619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:40.946921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:40.948346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:40.959699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 164/332] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:40.965589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:41.062084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:41.082446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049320de-4473-4060-9d20-5e9d4db212d3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:41.126158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:41.126798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:41.127076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:41.127345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] PATH_INFO: `/v3/users/351a95747ffe4180bfb99c2bbb18e5ab` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:41.128501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] RBAC: Authorizing `identity:get_user(user_id=351a95747ffe4180bfb99c2bbb18e5ab)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:41.129935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e679-cf16-48e1-8839-f52932b65ccb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:41.131899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 169/333] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:40 2022] GET /identity/v3/users/351a95747ffe4180bfb99c2bbb18e5ab => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:41.138059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:41.219526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:41.252338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34313d-9e3a-468c-8d16-0d05252e94c9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:41.296430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:41.297043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:41.297320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:41.297588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:41.298317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] RBAC: Adding query filter params (role.id=e17d5c4e47e7496eb2e1291f09499efd, user.id=351a95747ffe4180bfb99c2bbb18e5ab, scope.system=all) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:41.298623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:41.300087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28cf24-bc3a-4066-ae2d-414cd330a048 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:41.313353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 165/334] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 24 10:20:41 2022] GET /identity/v3/role_assignments?user.id=351a95747ffe4180bfb99c2bbb18e5ab&scope.system=all&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:42.509042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378fc0-580e-4c1f-bea2-9db916aa3620 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:42.509539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378fc0-580e-4c1f-bea2-9db916aa3620 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:42.509642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378fc0-580e-4c1f-bea2-9db916aa3620 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:42.511344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 170/335] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:42.528420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ea8b-b599-4510-8ff8-1d80facd1623 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:42.528908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ea8b-b599-4510-8ff8-1d80facd1623 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:42.528982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ea8b-b599-4510-8ff8-1d80facd1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:42.554203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ebe9ea8b-b599-4510-8ff8-1d80facd1623 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:42.555321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ebe9ea8b-b599-4510-8ff8-1d80facd1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:42.642293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 166/336] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:42.730778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b8194-4d25-4b08-9fbe-872c5b6343c3 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:42.731671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b8194-4d25-4b08-9fbe-872c5b6343c3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:42.732005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b8194-4d25-4b08-9fbe-872c5b6343c3 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:42.733740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 171/337] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:42.744716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:42.745004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:42.745277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:42.768773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:42.770025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:42.844022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:42.859991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 167/338] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:43.257118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b8194-4d25-4b08-9fbe-872c5b6343c3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:43.353885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:43.448508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b8194-4d25-4b08-9fbe-872c5b6343c3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:43.553972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:43.554578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e363a3-d673-4e59-9139-1382fc3cbb67 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:43.555609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:43.556082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:43.556492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:43.584818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:43.589884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:43.591008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:43.595897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:43.609205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 172/339] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:43.609205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:43.624687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:43.652513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:43.654423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:43.654708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:43.654981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:43.682057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4dfdd66a-6eb2-4014-bbb4-21e3243c47d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:43.696268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:43.697427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:43.698506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 168/340] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:43.703067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549dfd-cebc-4c2c-a4f4-24fdd7c62221 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:43.705877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549dfd-cebc-4c2c-a4f4-24fdd7c62221 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:43.705877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549dfd-cebc-4c2c-a4f4-24fdd7c62221 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:43.705877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 169/341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:43.706194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549dfd-cebc-4c2c-a4f4-24fdd7c62221 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:43.780693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865fd33-dd42-4036-b77a-4aabfd776644 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:43.826262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:43.827161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:43.827614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:43.828075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:43.828948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:43.831145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:43.833264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c4c4-5efe-4e43-bfa5-1d0ed5ccbb5a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:43.840143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:43.854435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 173/342] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:43.857856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:43.858139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:43.858406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:43.898143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:43.899682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:43.940647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549dfd-cebc-4c2c-a4f4-24fdd7c62221 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:44.023221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:44.024229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.024713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.025183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.026081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:44.026583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:44.031817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:44.042208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 174/343] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:44.043076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.048634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.058183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 170/344] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:44.065642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.217714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a989f-dad7-4a93-bb04-984ef37f2a7a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:44.248798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb6d8-7c21-410a-8724-6e3c936b251a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:44.257764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:44.258384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.258659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.258927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.264523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.300108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:44.301097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.301578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.303118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.351643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:44.353505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ec75-b813-4a4e-8094-2d39e2c3908e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:44.356363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.387124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:44.388982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:44.483714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 175/345] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:44.486022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2e6b-47e6-46da-99ed-cb94f4802869 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.486533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2e6b-47e6-46da-99ed-cb94f4802869 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.486992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2e6b-47e6-46da-99ed-cb94f4802869 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.489805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 176/346] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:44.491178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18490e-475d-4d26-9061-d230184c2121 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.491454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18490e-475d-4d26-9061-d230184c2121 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.491853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18490e-475d-4d26-9061-d230184c2121 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.493519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 177/347] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:44.494065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18490e-475d-4d26-9061-d230184c2121 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.513504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 171/348] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:44.514612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.532669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.628292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18490e-475d-4d26-9061-d230184c2121 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:44.629949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.638652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6882c-80fb-4ef2-8212-f37af40955f1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:44.673638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:44.674596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.675010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.675418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.682778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:44.683542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.683839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.684665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.686110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:44.688098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9c0b6-1e51-48fe-94a6-48d504c07681 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:44.689879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:44.690456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 172/349] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:44.691728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.692026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.692292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-05c7f16f-bf66-4d22-839d-eb93a9a09891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:44.696083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:44.697098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:44.698083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:44.702946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 178/350] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:44.704389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:44.704815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:44.705257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:44.712671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:44.714041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:44.729045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:44.730456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:44.804243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 173/351] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:44.805701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.821907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:44.829601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 179/352] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:44.831226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:44.941373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb3b8-d7d6-46d8-b8a0-df98047f08a9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.001396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.001396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.001396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.001396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.001791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.003428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.007805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 174/353] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.007805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.053710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.068680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3857-cef7-4583-bd05-d8f09ade6155 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.100686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.128694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.129271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1776-99a8-4d18-a5fb-9d193bcbde69 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.129381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.129604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.129876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.138091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.139932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.142077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 180/354] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:44 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.142695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.184124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.184744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.185448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.185874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.186715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:45.187023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.188609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.200739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 175/355] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.201795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.270398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba7f9-796c-4f38-9721-6cb14b6393a2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.316465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.316465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.316740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.316865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.319191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.320672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.322252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 181/356] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.323014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.338709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40fcf-9fe5-4e49-a931-eb18c79bea9d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.362096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.384533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.385199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.385435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.385700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.395100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.399888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:45.405892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:45.409005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 176/357] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:45.410128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.464573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f239c5-f84a-4011-9286-535cd9b427a2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.503901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.504509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.504786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.505057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.505783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=f32a052fd52b4cee853607ca12e9565d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:45.506097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.507527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.514380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 182/358] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.515637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.555771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9e2cc-c4da-400c-b6e4-d87300aab267 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.600673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.601268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.601547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.601809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.635822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.652064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbc1e-7bc1-458e-9c06-d89e8afc9ddd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.695267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.696917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.698380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.698380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.698380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.698623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.702162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.710215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:45.716532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:45.717482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 183/359] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:45.718266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.828817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 177/360] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:45.829852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.847403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc678-8cf6-4d8a-8cca-0bdf6984aeb4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:45.896066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:45.896597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.896878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.897153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.897882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=040e823c6d874b98830778582091d28a, scope.project.id=f32a052fd52b4cee853607ca12e9565d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:45.898191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:45.899642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598fa1-2113-48f4-9b44-c26f4c6b3f96 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:45.905937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 184/361] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=040e823c6d874b98830778582091d28a => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:45.906968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6338-d130-4682-980e-5b3775696773 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:45.907250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6338-d130-4682-980e-5b3775696773 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:45.907525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6338-d130-4682-980e-5b3775696773 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:45.909068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 185/362] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:45.909838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f6338-d130-4682-980e-5b3775696773 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:45.930688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.965641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:45.971836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e59b7-fd7d-41f0-88ea-0d1fb586f179 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.019953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.020473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.020753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.021025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.021702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:46.022005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.023931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.034262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 178/363] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.035367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.054148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f6338-d130-4682-980e-5b3775696773 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.107845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.108456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.108741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.109011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.109689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:46.109990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.112001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c0db-9761-4ddb-8084-2079b47e8ea0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.125027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 186/364] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.126882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.127167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.127442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.155541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:46.156995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:46.174392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6b29-e14e-421e-86b8-3a6ebf2667b8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.228419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.229786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.229786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.229786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.232766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.234916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.237715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 179/365] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.238686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.259934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 187/366] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:46.261206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.265384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.286508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.375675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c0150-887f-4fb4-af3e-4cfea2817361 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.380106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c193b-741e-4f0f-9b08-b21878482041 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.415121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.416096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.416607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.417022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.417285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] PATH_INFO: `/v3/users/7fdb281b296d4057931005d191f623ab` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.417767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.418118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.419227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.419934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7fdb281b296d4057931005d191f623ab)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.421576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.423579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 188/367] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/users/7fdb281b296d4057931005d191f623ab => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.424566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.497923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.499393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.516174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.530499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.533750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dec900-52fc-4e36-a656-d10aa94e20f7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.569872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.570839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.571316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.571821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.573195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.574833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.576956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 189/368] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.577923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.612075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 180/369] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:46.613515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.697082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39ef7e-a608-42bb-9658-79e8012c1775 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.726568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea2b5-e313-47c9-97a3-505160c66c9b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.738060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.739022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.739520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.740017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.740901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] RBAC: Adding query filter params (role.id=01d728abd8844cb394ddaa2629c81871, user.id=7fdb281b296d4057931005d191f623ab, scope.system=all) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:46.741506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.743143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.756058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 190/370] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/role_assignments?user.id=7fdb281b296d4057931005d191f623ab&scope.system=all&role.id=01d728abd8844cb394ddaa2629c81871 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.756675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.759524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:46.761395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.768531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.769233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.770139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.770139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.770684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:46.771062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.772620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.779611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 181/371] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.881930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f2f-533f-4c10-9936-03adfba4b998 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:46.924940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:46.925597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:46.925874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:46.926137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:46.927333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:46.928859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:46.930952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 191/372] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:46.937393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:46.939192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:47.047474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.075120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873699f-d2a1-4057-b31e-3e8d19780abc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:47.080054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4012f08-47eb-42fb-a07a-711e07fff3cf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:47.113654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:47.114622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:47.115080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:47.115524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:47.118011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:47.119852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:47.122713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 182/373] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:47.129770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:47.144564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:47.145219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:47.145487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:47.145758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:47.172783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:47.178022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:47.178947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:47.179755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 192/374] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:47.185573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:47.216313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.285114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc3e2-9ed2-4fc9-b6ec-50d0ca8c079c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:47.351991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:47.352610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:47.352889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:47.353281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:47.354054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=040e823c6d874b98830778582091d28a, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:47.354364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:47.356375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:47.365491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 183/375] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:47 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=040e823c6d874b98830778582091d28a => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:47.421856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc44e4-729e-4f34-bdbe-b285484cd99e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:47.460967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.469621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:47.480152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:47.490354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 193/376] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:47.497104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:47.624106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29518476-4c4b-4d02-8d4f-3c62352b454a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:47.650648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.659361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:47.669207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:47.669207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:47.669207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:47.732104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:47.733812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:47.836385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 184/377] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:47.844897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:47.977418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff913-817c-4949-a855-5de7c20fd25f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:48.022673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:48.023350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.023621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.023965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] PATH_INFO: `/v3/projects/81ae17c3c2d745c786962a42b9714f09` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.025087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] RBAC: Authorizing `identity:get_project(project_id=81ae17c3c2d745c786962a42b9714f09)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:48.026521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:48.028646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 194/378] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:47 2022] GET /identity/v3/projects/81ae17c3c2d745c786962a42b9714f09 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:48.034121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:48.075726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:48.183155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed692a-42b2-483e-9a1b-ff069908366b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:48.225446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:48.226075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.226348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.226616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] PATH_INFO: `/v3/groups/d6098e6938474709b4f3dd8e599ddf8b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.233669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] RBAC: Authorizing `identity:get_group(group_id=d6098e6938474709b4f3dd8e599ddf8b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:48.235130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e30aca-16c6-43a4-ad17-da54d629862c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:48.237202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 185/379] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:48 2022] GET /identity/v3/groups/d6098e6938474709b4f3dd8e599ddf8b => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:48.244848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:48.348831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:48.407642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d905be-fcc2-4d15-b85d-1c8109931a62 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:48.446409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:48.447017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.447292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.447555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.448305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] RBAC: Adding query filter params (group.id=d6098e6938474709b4f3dd8e599ddf8b, role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=81ae17c3c2d745c786962a42b9714f09) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:48.448613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:48.451076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc160-a9fa-4bb8-9009-aa74bf791e19 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:48.459009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 195/380] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:48 2022] GET /identity/v3/role_assignments?group.id=d6098e6938474709b4f3dd8e599ddf8b&scope.project.id=81ae17c3c2d745c786962a42b9714f09&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:48.469332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed780-9369-4069-8131-98be9768065e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.469955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed780-9369-4069-8131-98be9768065e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.470421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed780-9369-4069-8131-98be9768065e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.473718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 186/381] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:48.478986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.479275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.479613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.503393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:48.504946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:48.515016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4546-5178-4173-98ad-5c9418e46578 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.515629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4546-5178-4173-98ad-5c9418e46578 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.516172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca4546-5178-4173-98ad-5c9418e46578 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.518042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 187/382] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:48.523077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:48.523680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:48.524166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:48.547440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:48.549516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:48.642491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 188/383] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:48.666444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 196/384] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:48.938221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:48.966178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.064943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e76ffb-2c70-49db-8af7-c4a9e11681b9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.102426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.103063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.103337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.103661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.114767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:49.119499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:49.120471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:49.121251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 189/385] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:49.128580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.150867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.227739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.255458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.283010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eab-0838-4d08-b58e-94e9729c8e60 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.297584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c633-1aa3-4568-ae99-e37bf48fb109 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.332397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.333141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.333420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.333693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.346005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.347124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.347545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.347994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.349095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:49.349506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:49.349685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:49.351449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d4db-4586-44d9-a757-eac4819d6b3b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-fbed9048-0fff-4e18-adb9-fb81bbbcd4a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:49.354798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:49.356387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 190/386] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:49.358512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fe81-1a77-4042-9c6e-ac9d95e5a1b0 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.358777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fe81-1a77-4042-9c6e-ac9d95e5a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.359061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0fe81-1a77-4042-9c6e-ac9d95e5a1b0 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.360329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 191/387] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:49.366189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0fe81-1a77-4042-9c6e-ac9d95e5a1b0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.366497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 197/388] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:49.368019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.368444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.368877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.391027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:49.392795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:49.491323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 198/389] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:49.492466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.497270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0fe81-1a77-4042-9c6e-ac9d95e5a1b0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.542607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.585792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.586794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.587284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.587808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.589040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:49.589783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:49.592260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:49.608004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8999fa-016e-4211-bb3d-21c6a7006ad2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.609078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 192/390] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:49.617568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.625637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.656573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.658585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.659035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.659504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.661705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:49.664251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:49.668435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 199/391] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:49.674307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.765881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03234f8-db55-49c9-a023-8910c877b71b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.822599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.824378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.826674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.827712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.830266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:49.832815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:49.838579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 193/392] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:49.847302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.894843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d90f-cca7-423d-87e3-8ad7274d223f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:49.907389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.934654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:49.935917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:49.936396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:49.936767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:49.938073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:49.938989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:49.947378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:49.947378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 200/393] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:49.947378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:49.977633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3471-51a6-46e8-9c5d-2e2d67d41694 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.049598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.050729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.051404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.052182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.054216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:50.057320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:50.062262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 194/394] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:50.063728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:50.067301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8a6a8-e2a5-4dc9-a162-b6e30a6d68ef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.103490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.105070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.106337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.106857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.118316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:50.123824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:50.124676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:50.125462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:50.128091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 201/395] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:50.129130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:50.171028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:50.238795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da280-cc1f-451a-bb82-9e09b3d4779d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.256993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c2dd-ba64-484a-82dd-9d6613622d57 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.277327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.279033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.279498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.279970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/groups/e9e0e100697b45e188aba1a64579d0ce/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.282384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, group_id=e9e0e100697b45e188aba1a64579d0ce, role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:50.284043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:50.301805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.301805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.301805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.301805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d/groups/e9e0e100697b45e188aba1a64579d0ce/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.303292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f32a052fd52b4cee853607ca12e9565d, group_id=e9e0e100697b45e188aba1a64579d0ce, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:50.304880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d6497-b5fe-4b6f-a2b1-f82e345b93d2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:50.400347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 202/396] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 24 10:20:50 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/groups/e9e0e100697b45e188aba1a64579d0ce/roles/040e823c6d874b98830778582091d28a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:50.401296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:50.407549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:50.413858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 195/397] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 24 10:20:50 2022] PUT /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d/groups/e9e0e100697b45e188aba1a64579d0ce/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:50.415225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f67e-783d-453d-86b5-f0959796a33c None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.415508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f67e-783d-453d-86b5-f0959796a33c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.415942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f67e-783d-453d-86b5-f0959796a33c None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.417847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 196/398] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:50.432548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.432868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.433241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.474481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:50.478083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:50.597916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:50.608816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ec2a-7b83-442c-ad79-31c07b3e32bc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.646456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 197/399] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:50.670958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.671586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.671980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.672252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.672973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:50.673272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:50.674697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:50.684401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 203/400] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:50.690312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:50.813986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffc388-76ca-4872-8d24-152160bddacc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:50.844575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:50.852551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:50.853521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.853802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.854073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.855192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:50.857397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe327a-f6e6-47e6-8954-70f5b171c919 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:50.859317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 198/401] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:50 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:50.864837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:50.960118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9466c-b32b-4e56-9ccb-b7efaab9ba1b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.960643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9466c-b32b-4e56-9ccb-b7efaab9ba1b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.961021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9466c-b32b-4e56-9ccb-b7efaab9ba1b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.962709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 199/402] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:50.968206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:50.968483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:50.968750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:50.998948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:51.000290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:51.001344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21f0c3-41f5-421d-8784-cabd011d92b8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.062731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.063366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.063644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.063951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.065072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.066635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.068729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 204/403] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:50 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:51.069515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.101742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.110332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 200/404] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:51.111196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.186200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e944d9-2e05-4cb8-b62b-2ed8c5c6d233 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.226272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.226988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.227268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.227592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.239206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:51.240675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ff36-95ee-4b74-968e-4e09b6a4e786 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:51.245867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:51.247527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:20:51.249502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 205/405] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:51.259806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.269584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.290306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.290971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.291247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.291519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/groups/e9e0e100697b45e188aba1a64579d0ce/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.298900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, group_id=e9e0e100697b45e188aba1a64579d0ce, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.299163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.379076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.383242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 201/406] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 24 10:20:51 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/groups/e9e0e100697b45e188aba1a64579d0ce/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:51.401771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829c6c-0420-4a8e-b0bc-66d1f68fbce9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.447021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.448114 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.448689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.449495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.451094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:51.452232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.454020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.460825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.464504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 206/407] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:51.473861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.630646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fdc17-6283-4a83-928a-5a7e373ae4db None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.633920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77691d48-653b-44c7-8008-bf9d26153617 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.673567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.673790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.674209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.674323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.674498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.674596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.674742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.674841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.675900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.677353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.678937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 207/408] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:51.685297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.700950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:51.706241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:51.707173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:51.708638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 202/409] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:51.714232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.726563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.800158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.885697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ed56-4f78-4ed7-9c79-73e8b1b4e139 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.906275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce68da-b4ae-4f1b-a717-2b4308b1923f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:51.961459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.962071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.962351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.962622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.963296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:51.963599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.965772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.975567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 203/410] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:51.978904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:51.979861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:51.980316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:51.980820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:51.982269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:51.983951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:51.984824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:51.986399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 208/411] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:51.992613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:52.149675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b579-fd41-4d21-9621-eb98a70a8328 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:52.160124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:52.164977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:52.180259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66a2f-06aa-4db9-94cd-0ce099e8319f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:52.212774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] PATH_INFO: `/v3/groups/d6098e6938474709b4f3dd8e599ddf8b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] RBAC: Authorizing `identity:get_group(group_id=d6098e6938474709b4f3dd8e599ddf8b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:52.220254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 204/412] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:51 2022] GET /identity/v3/groups/d6098e6938474709b4f3dd8e599ddf8b => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:52.227122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:52.245883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:52.247470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.249246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.249518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/groups/e9e0e100697b45e188aba1a64579d0ce/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.253701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73, group_id=e9e0e100697b45e188aba1a64579d0ce, role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:52.255149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:52.338152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 209/413] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 24 10:20:51 2022] PUT /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73/groups/e9e0e100697b45e188aba1a64579d0ce/roles/040e823c6d874b98830778582091d28a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:52.388447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59058-1cc0-45cd-9161-3f8f86f1f097 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:52.443254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:52.443920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.444203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.444475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] PATH_INFO: `/v3/projects/81ae17c3c2d745c786962a42b9714f09` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.445616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] RBAC: Authorizing `identity:get_project(project_id=81ae17c3c2d745c786962a42b9714f09)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:52.447131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8419947-ba0c-4e5f-95b8-f1f77b5e1944 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:52.449167 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 205/414] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:52 2022] GET /identity/v3/projects/81ae17c3c2d745c786962a42b9714f09 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:52.455098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:52.601473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0bc29-de2f-4efc-80b7-1a45542adeb8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:52.639237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:52.639924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.640203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.640475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] PATH_INFO: `/v3/projects/81ae17c3c2d745c786962a42b9714f09/groups/d6098e6938474709b4f3dd8e599ddf8b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.642512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=81ae17c3c2d745c786962a42b9714f09, group_id=d6098e6938474709b4f3dd8e599ddf8b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:52.644064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2fff1-381d-4887-8eee-07c35fc0bac5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:52.721985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 210/415] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 24 10:20:52 2022] PUT /identity/v3/projects/81ae17c3c2d745c786962a42b9714f09/groups/d6098e6938474709b4f3dd8e599ddf8b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:20:52.797831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e677f-cc61-4250-a8bd-4256171b79f9 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.798162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e677f-cc61-4250-a8bd-4256171b79f9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.798379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e677f-cc61-4250-a8bd-4256171b79f9 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.800061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 206/416] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:52.805828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8ab8-254a-4142-81c0-3ad078ae66c7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:52.806111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8ab8-254a-4142-81c0-3ad078ae66c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:52.806376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8ab8-254a-4142-81c0-3ad078ae66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:52.820392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:52.826992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-69be8ab8-254a-4142-81c0-3ad078ae66c7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:52.828414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-69be8ab8-254a-4142-81c0-3ad078ae66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:52.933592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 211/417] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:53.058366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d6f-a4fb-4053-9af6-a282a6874931 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.058674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d6f-a4fb-4053-9af6-a282a6874931 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.059180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2d6f-a4fb-4053-9af6-a282a6874931 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.060248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 207/418] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:53.066048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.066424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.066702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.089421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:53.090710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:53.175624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 212/419] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:53.300012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2d6f-a4fb-4053-9af6-a282a6874931 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:53.369783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.439202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2d6f-a4fb-4053-9af6-a282a6874931 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:53.473609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:53.474334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.474613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.475132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.490406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:53.497517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:53.498422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:53.499315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 208/420] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:53.504806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:53.516585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:53.601197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.634611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d72196-72a2-4e9f-ad6c-03b8508a334d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:53.676723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:53.679239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.679239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.679239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.679239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:53.679239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:53.680358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:53.690529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 213/421] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:53.700843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:53.722955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729acfd-a08d-4122-8791-853a10318f96 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:53.748201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.791664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:53.792693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.793834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.794428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.809786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-c6e66739-aba2-43ee-9a30-f75f2bc7c73f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:53.817054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:53.817989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:53.818835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:53.821714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 209/422] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:20:53.823496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe275c-10d3-451f-ba98-b86d4eb5b36a None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.823971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe275c-10d3-451f-ba98-b86d4eb5b36a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.824679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe275c-10d3-451f-ba98-b86d4eb5b36a None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.826432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 210/423] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:53.827301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe275c-10d3-451f-ba98-b86d4eb5b36a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:53.844789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960c311-b70e-4712-b797-56b1bbc3c795 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:53.876544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.885245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:53.885878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:53.886159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:53.886550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:53.962957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:53.964615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:53.977660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe275c-10d3-451f-ba98-b86d4eb5b36a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.016097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.016549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.016896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.017233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.017963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:54.018331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.019806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c280bd-ae0b-47d4-841e-f64ab76d13fe None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.028705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 211/424] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:54.030475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.030475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.030791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.049719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:54.051288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:54.072650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.089560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 214/425] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:54.097902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.125466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.144064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 212/426] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:54.144064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.262637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ebd6a-57c3-4d28-a3ab-6dec9692839b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.268139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5710-a291-4a47-891a-3375a1f11a8e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.306370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.307562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.308073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.308524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.310828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.312581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.315671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 213/427] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:54.321879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.326487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.326487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.326973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.327340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.354987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.466872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d954-b5e7-482f-be27-ea093bd291f0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.471462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.473067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.506826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.508389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.509135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.509621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.511597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.514975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.516053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.518773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 214/428] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:54.524643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.610528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 215/429] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:54.611926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.657207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.666502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4452-49a8-4d05-b644-97d0fb5bb010 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.705522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.706141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.706617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.707095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.718461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:54.722120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a7ad-1e49-4724-b366-417d697cd8fe None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:54.723600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:54.724488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:20:54.725525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:54.733882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 215/430] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:54.735051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.752578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.760945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.761671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.762677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.763070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.763807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=f32a052fd52b4cee853607ca12e9565d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:54.764227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.765690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.772024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 216/431] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:54.772789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.852656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd3fc-3bb2-4187-bc96-5a8df0caef42 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.892285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.893308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.893788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.894281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] PATH_INFO: `/v3/projects/f32a052fd52b4cee853607ca12e9565d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.895687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f32a052fd52b4cee853607ca12e9565d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.897387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f96e6-16f8-4cad-a98a-bd5fe88116c0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.899402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 216/432] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/projects/f32a052fd52b4cee853607ca12e9565d => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:54.900627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57d68-97fd-402c-a0a6-c1a6adf4a273 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:54.901143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b23ae-96c4-409a-990f-b516000cace1 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.901611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b23ae-96c4-409a-990f-b516000cace1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.902082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b23ae-96c4-409a-990f-b516000cace1 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.905190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 217/433] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:54.906266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b23ae-96c4-409a-990f-b516000cace1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:54.930557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.940718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:54.941388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.941670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.941950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.942671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:54.942977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:54.944437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba556f-f5bf-40a2-a759-3fee32823184 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:54.954477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 217/434] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:54.955713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:54.956020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:54.959692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:54.981227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:54.983103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:55.046926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.051171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b23ae-96c4-409a-990f-b516000cace1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.070858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 218/435] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:55.071997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.107094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.108303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.108745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.109283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.110904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.113481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.119712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 218/436] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:54 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:55.123515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.205747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773604a5-3c6a-43fd-ba72-531e8e5f686e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.245997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.248169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.248286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.248286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.248414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.262889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fa220-d396-4ce7-ad4f-d3b3ba3e632f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.311122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.311812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.312090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.312413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.312524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.313202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=040e823c6d874b98830778582091d28a, scope.project.id=f32a052fd52b4cee853607ca12e9565d) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:55.313515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.314965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1021bd-e3bd-4f19-9824-96ea316fc5c7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.321054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 219/437] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=f32a052fd52b4cee853607ca12e9565d&role.id=040e823c6d874b98830778582091d28a => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:55.322199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346440-5833-44c4-9238-8ae71312dd91 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.322477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346440-5833-44c4-9238-8ae71312dd91 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.322992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346440-5833-44c4-9238-8ae71312dd91 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.324186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 220/438] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:55.330638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.330942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.331246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.335086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.337102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.357439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:55.358903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:55.452125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 221/439] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:55.452990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.460972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 219/440] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:55.461929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.563001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.584522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869e8a-9e2f-4947-9446-9ab5c581b569 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.584703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.604124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e52-ead5-4183-a5ff-efa1dcaa7f45 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.620006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.620642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.620913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.621306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.634794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:55.640155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:55.641039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:55.642032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 222/441] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:55.647185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.654754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.655381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.655653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.655982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.658172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.659719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.661812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 220/442] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:55.667047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.773321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86502b20-43a5-4ee7-b791-470adc010db9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.792156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc8f5-fd4d-450e-85da-b251999911b4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.808590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.809722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.809985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.810246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.810898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:55.811197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.812590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.820384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 223/443] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:55.823737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.826712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.827508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.827902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.828621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.828895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.830029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:55.831461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:55.833066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 221/444] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:55.833869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:55.857465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:55.929161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909737b4-c671-4606-baa3-d2752d9ac064 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.934588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29d8a-e2fe-4416-a593-ca2e2bed97fa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:55.962897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.963619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.963919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.964186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.967988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:55.968577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:55.968852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:55.969118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:55.974269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:20:55.979636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:20:55.980616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:20:55.981479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 224/445] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:20:55.982197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.037926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.039364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.044077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.060470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.081138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5f9b6-355c-423d-90d5-652926d61359 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.119338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.120008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.120287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.120554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.121860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=e17d5c4e47e7496eb2e1291f09499efd, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:56.122277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.123705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.129384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 225/446] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=e17d5c4e47e7496eb2e1291f09499efd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:56.130155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.153156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 222/447] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:56.159080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.252961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f96d-6670-4047-a0b4-485b46e02ab7 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.278480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa82a4-a705-49bb-84ab-629f5c5444d2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.283342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.292467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.293614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.293894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.294165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.295380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:56.295685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.297879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.305797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.311393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 226/448] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:56.317543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.323652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.324879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.325118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.325388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] PATH_INFO: `/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.326529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] RBAC: Authorizing `identity:get_project(project_id=d68ec5a59cb84f1ab30ca6d35ce33d73)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.328003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.331885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 223/449] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/projects/d68ec5a59cb84f1ab30ca6d35ce33d73 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:56.335321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.430363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b74c-483d-4f21-b43c-5f146c3a91c9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.465131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cc76-5ac6-47ed-bdf7-0999c920e98b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.474441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.475403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.475679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.475984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.508670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.509297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.509574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.509846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] PATH_INFO: `/v3/groups/e9e0e100697b45e188aba1a64579d0ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.510990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] RBAC: Authorizing `identity:get_group(group_id=e9e0e100697b45e188aba1a64579d0ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.513083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.514671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 224/450] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/groups/e9e0e100697b45e188aba1a64579d0ce => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:56.520458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.540082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.550229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.551677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.576435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.619506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15625e-c546-430e-bc50-00b4e9c7e157 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.651494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 227/451] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:56.656667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.656667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.656667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.656667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.656969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] RBAC: Adding query filter params (group.id=e9e0e100697b45e188aba1a64579d0ce, role.id=040e823c6d874b98830778582091d28a, scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:56.656969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.656969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.657536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.663073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 225/452] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/role_assignments?group.id=e9e0e100697b45e188aba1a64579d0ce&scope.project.id=d68ec5a59cb84f1ab30ca6d35ce33d73&role.id=040e823c6d874b98830778582091d28a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:20:56.752034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.761383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f974074-6079-429c-9cc1-734f753a3d8b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.797664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.798310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.798591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.798863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] PATH_INFO: `/v3/projects/81ae17c3c2d745c786962a42b9714f09` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.800045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] RBAC: Authorizing `identity:get_project(project_id=81ae17c3c2d745c786962a42b9714f09)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.801494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.803114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 228/453] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/projects/81ae17c3c2d745c786962a42b9714f09 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:56.809524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:56.911905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667893-a37e-4bbf-8246-731b70898bbe None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:56.932855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:56.946749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:56.947369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:56.947644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:56.947944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] PATH_INFO: `/v3/groups/d6098e6938474709b4f3dd8e599ddf8b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:56.949062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] RBAC: Authorizing `identity:get_group(group_id=d6098e6938474709b4f3dd8e599ddf8b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:56.951385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9448-e2d7-4ef2-8916-3fca00081baa None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:56.953048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 226/454] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/groups/d6098e6938474709b4f3dd8e599ddf8b => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:56.959236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:57.062042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5489b6c-b3a5-4a4e-b579-284554370a0a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:20:57.094830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:20:57.095424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:57.095699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:57.095994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:57.096708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] RBAC: Adding query filter params (group.id=d6098e6938474709b4f3dd8e599ddf8b, role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=81ae17c3c2d745c786962a42b9714f09) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:20:57.097012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:20:57.098442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfae998-6205-4b10-a3f3-07c28e7150a7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:20:57.104377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 229/455] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 24 10:20:56 2022] GET /identity/v3/role_assignments?group.id=d6098e6938474709b4f3dd8e599ddf8b&scope.project.id=81ae17c3c2d745c786962a42b9714f09&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:20:59.427821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625348-da3f-4473-a7c3-d6b28a1b3fca None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.428323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625348-da3f-4473-a7c3-d6b28a1b3fca None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.428397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625348-da3f-4473-a7c3-d6b28a1b3fca None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.429918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 227/456] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:59.435853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4235-e351-424e-b571-2a8379bc3d8f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.436261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4235-e351-424e-b571-2a8379bc3d8f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.436426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4235-e351-424e-b571-2a8379bc3d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.464234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4a8e4235-e351-424e-b571-2a8379bc3d8f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:59.465494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4a8e4235-e351-424e-b571-2a8379bc3d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:59.483096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:59.534448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 230/457] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:20:59.660380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d577ea-d5f1-42d3-be8a-3de8eeffc209 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.660559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d577ea-d5f1-42d3-be8a-3de8eeffc209 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.660827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d577ea-d5f1-42d3-be8a-3de8eeffc209 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.662400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 228/458] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:20:59.667500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b061-5ac6-472a-a3ea-a0448ff63d27 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.668041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b061-5ac6-472a-a3ea-a0448ff63d27 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.668676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b061-5ac6-472a-a3ea-a0448ff63d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.691263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-bb01b061-5ac6-472a-a3ea-a0448ff63d27 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:20:59.692776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bb01b061-5ac6-472a-a3ea-a0448ff63d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:20:59.765933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 231/459] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:59.861587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d577ea-d5f1-42d3-be8a-3de8eeffc209 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:20:59.960678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9e95-9ccd-42d1-8cec-92c8029da2bb None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.961309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9e95-9ccd-42d1-8cec-92c8029da2bb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.961798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9e95-9ccd-42d1-8cec-92c8029da2bb None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.963559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 232/460] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:20:59.969818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:20:59.970333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:20:59.970827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:20:59.997813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d577ea-d5f1-42d3-be8a-3de8eeffc209 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.000802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:00.008369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:00.062902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.064546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.065204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.066573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.087996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.089770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:00.112127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:00.113109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:00.113963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:00.113963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.113963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:00.116228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 229/461] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:00.117197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.128099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 233/462] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:21:00.135817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.146098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.189687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.281330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057139-0139-4ff9-872a-cc70b57cecd8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.305351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270f80-007c-498e-9460-48247bfd5897 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.343895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.344508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.344786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.345128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.345764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:00.346288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.347817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44164-a39b-4144-8641-8606a4f77206 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.349301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.350336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.350675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.351083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.362486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.364256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.365841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 234/463] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:00.367473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a89-a798-4950-96bb-266c2135ce3e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.367952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a89-a798-4950-96bb-266c2135ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.368367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a89-a798-4950-96bb-266c2135ce3e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.370056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 235/464] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:00.370973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216a89-a798-4950-96bb-266c2135ce3e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c1c8c177-c216-4975-919b-e7f099fe5051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:00.383937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:00.384848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:00.385778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:00.385778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.385778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:00.385778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 230/465] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:00.391951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.392367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.392744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.410995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:00.412350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:00.473583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.494348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 231/466] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:00.495904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.516099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216a89-a798-4950-96bb-266c2135ce3e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.524266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.561209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.562148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.562428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.562699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.563618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.565744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.613967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a46ff-6ab5-48e8-8ee4-7eb8cafcfa30 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.651540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.652520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.653081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.653528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.654423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:00.654861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.656475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.668968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 232/467] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:00.670012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.759020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.772741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 236/468] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:00 2022] POST /identity/v3/users => generated 246 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:00.774358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.790359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55f48-734a-4657-a4f5-2e92318ccf47 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.833366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.834330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.834896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.835178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.849233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.851521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:00.874302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:00.875247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:00.876127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:00.876127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:00.876127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:00.880113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 233/469] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:00.882915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:00.933075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974c0ea-039d-4ef7-891a-3d6613a18fe5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:00.966561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.976633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:00.977237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:00.977511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:00.977779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:00.981294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:00.982736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.000068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c403-2ffa-4f89-8b76-c10ec27b3e7c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.043445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.044116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.044568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.044720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.046720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:01.056750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.058385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.062409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 237/470] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:00 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:01.063248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1816bb3c-8ff5-499d-8176-42a441b90ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:01.077182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:01.078353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:01.079401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:01.079401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:01.079401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:01.081261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 234/471] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:01.082751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dccb1-c3f4-45dd-9230-30641f006590 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.083176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dccb1-c3f4-45dd-9230-30641f006590 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.083628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dccb1-c3f4-45dd-9230-30641f006590 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.085591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 235/472] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:01.088188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dccb1-c3f4-45dd-9230-30641f006590 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:01.211394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574cc9-07ce-4ffa-ba74-684caf9d8f9a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.212257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dccb1-c3f4-45dd-9230-30641f006590 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.266591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.267235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.267579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.267979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.268458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:01.268865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.269013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.269528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.269804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.270076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.270404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.270714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:01.271017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.272787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a5e2e-7fd3-42d7-b1f1-9fec773d620f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.290148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 236/474] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:01.291696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.292130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 238/474] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:01.292242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.292327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.297582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:01.319390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:01.321089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:01.373585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:01.376255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:01.398693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 237/475] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:01.399726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:01.445945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c848-a1eb-4196-b3c3-c8d735d9e1b7 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.489590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.490235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.490475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.490756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.491393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.492999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.529814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06991cc0-f323-4b06-9a31-1f10ab4c0807 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.566227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.566891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.567171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.567444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.568171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.569655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.616195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 239/476] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:01 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:01.658791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 238/477] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:01 2022] POST /identity/v3/users => generated 249 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:01.754497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:01.865657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:01.868873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001422e0-146f-4bcb-946a-5f14d3663e9e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:01.904437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:01.905206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:01.905479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:01.905794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:01.906410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:01.907909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:01.942072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.sql.core [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:21:01.942072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:21:01.942072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [parameters: {'id': '016d6db7d08e4ff6a5c9c4513136ea66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:21:01.942072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81655) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:01.958857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:01.959868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application yield resource Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise self.value Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application session.commit() Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:21:01.960826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:21:01.961681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:01.962593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:01.963431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [parameters: {'id': '016d6db7d08e4ff6a5c9c4513136ea66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:01.966757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:21:01.968834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:01.970210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 240/478] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 24 10:21:01 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:01.970283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:02.005771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:02.101274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e584-02a3-4a82-8538-794a3d4d83d9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:02.150870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:02.151732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:02.152167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:02.152699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:02.169472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cd5f1bd7-508b-469e-94f8-af31ee42fc74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:02.174426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:02.175475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:21:02.176483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:02.178725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 239/479] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:02.184456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:02.326573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e855d0-a2e2-4e07-9a1c-af64fe3c840c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:02.373540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:02.374199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:02.374477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:02.374742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:02.375407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:02.375704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:02.377095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996b9d-f446-46ef-b1ef-050cd4f8ebbd None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:02.391758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 241/480] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:02.976454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c9da-1c37-4b57-8ef3-ae5706ccf339 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:02.976986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c9da-1c37-4b57-8ef3-ae5706ccf339 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:02.976986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3c9da-1c37-4b57-8ef3-ae5706ccf339 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:02.978563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 240/481] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:02.984389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd27-48ed-4a4a-b3e6-5b341595aee2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:02.984820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd27-48ed-4a4a-b3e6-5b341595aee2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:02.984998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bbd27-48ed-4a4a-b3e6-5b341595aee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:03.007932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-595bbd27-48ed-4a4a-b3e6-5b341595aee2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:03.009124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-595bbd27-48ed-4a4a-b3e6-5b341595aee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:03.039197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:03.100703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 242/482] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:21:03.419774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3686-2482-49ae-bbaf-7bfad85cd9a2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:03.420153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3686-2482-49ae-bbaf-7bfad85cd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:03.420348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3686-2482-49ae-bbaf-7bfad85cd9a2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:03.422521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 241/483] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:03.428003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:03.428288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:03.428560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:03.452737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:03.453928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:03.515477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f3686-2482-49ae-bbaf-7bfad85cd9a2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:03.556277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 243/484] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:03.669526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:03.683128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f3686-2482-49ae-bbaf-7bfad85cd9a2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:03.724407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:03.725299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:03.725577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:03.725847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:03.744618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:03.749323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:03.750196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:03.751392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 242/485] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:03.756539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:03.897865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:03.903712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:03.924012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9054f42-f000-43cb-b76a-9d1a9014fec0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:03.990352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:03.991768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:03.992277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:03.992786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:03.993689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:03.994188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:03.997620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.013525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 244/486] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:04.017640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.114211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd11b-40e4-4a26-ab1d-42a7b64476d0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.159018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f42127-9b48-4f89-bee2-c135d2461808 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.195445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.196094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.196365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.196627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.197184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.198105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.198581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.199086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.208044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:04.211472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-13c7e403-11e2-487a-953d-fb332763d0cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:04.212743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:04.213597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:04.214401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:04.216661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.218754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 243/487] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:04.220122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac672-cbd5-4749-9dfb-084e0ca8b2c1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.220400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac672-cbd5-4749-9dfb-084e0ca8b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.220662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac672-cbd5-4749-9dfb-084e0ca8b2c1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.222216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 244/488] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:04.227513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.228991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ac672-cbd5-4749-9dfb-084e0ca8b2c1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-51568d9d-1d4e-45bd-a820-c58a948f0a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:04.234750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:04.240221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 245/489] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.241251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.247954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.258257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:04.259603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:04.339842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 246/490] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:04.340938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.375036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ac672-cbd5-4749-9dfb-084e0ca8b2c1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.422596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.423204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.423483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.423756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.424444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:04.424744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.426158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e0fd4-3431-4d43-a59b-339a07b176ab None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.437165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 245/491] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:04.438613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab256f-4924-4426-9abc-06520a2b33f5 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.438883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab256f-4924-4426-9abc-06520a2b33f5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.439154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab256f-4924-4426-9abc-06520a2b33f5 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.443914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 246/492] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:04.444987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab256f-4924-4426-9abc-06520a2b33f5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.460596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbd49e-6443-4b92-94ad-c931530e1999 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.492950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.500207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.501121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.501543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.502008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.502800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:04.503242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.504912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b36ea-c6a1-4eed-957a-64a227d10ba6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.517871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 247/493] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:04.520494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.520933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.521396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.543349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:04.544975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:04.546270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.580247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab256f-4924-4426-9abc-06520a2b33f5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.619732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 248/494] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:04.621781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.630171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.630814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.631091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.631359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.649019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.650470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:04.665350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:04.666472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:04.667704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:04.667704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:04.667704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:04.667704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 247/495] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:04.667704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.745962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdfd1d-cf32-45b0-97d9-1ddce4210328 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.770621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.772562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8baf-72e1-4990-8dae-4373811619f5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.787042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.787957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.788510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.789098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.797461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.798498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:04.801166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.807123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.807748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.808056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.808321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:04.816179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:04.817272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:04.818326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:04.820005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:04.820393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 249/496] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:04.821372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:04.829979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:04.831089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:04.832076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 248/497] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:04.832897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:04.938842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcfd-8a72-48ea-a213-e6a3521f597a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.943259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e49f-e1dd-43ac-b63b-aed7e78c78be None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:04.976045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.976716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.976943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.977179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.977921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:04.978196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.979980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:04.980083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:04.981904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:04.981904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:04.983816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:04.984397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:04.984732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:04.986122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.003715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 250/498] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.003715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.018636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 249/499] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.019474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.049039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.066204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.106591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb302f9-eb97-4810-9d97-534583420f86 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.119334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7b3f0-2604-4ac7-a231-005535406362 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.141583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.142169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.142448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.142711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.143354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:05.143651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.145040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85296ed-880f-449b-883d-565eabbc4045 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.152813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 251/500] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.153946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053baca-2f18-4afd-bdf9-5158f6c28cb5 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.154222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053baca-2f18-4afd-bdf9-5158f6c28cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.154485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053baca-2f18-4afd-bdf9-5158f6c28cb5 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.155669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 252/501] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:05.156371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053baca-2f18-4afd-bdf9-5158f6c28cb5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.159466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.160733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.161045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.161356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.172485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:05.177735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:05.178687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:05.179489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 250/502] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:05.180163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.260679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053baca-2f18-4afd-bdf9-5158f6c28cb5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.262886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.283211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3a541-c41a-4309-b83d-8298670dd477 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.285494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.295077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.295894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.296375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.296807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.304754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.306241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:05.318296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:05.319239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:05.320254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:05.320754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.320840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 253/503] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:05.320913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.320980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.321053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.321053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.394403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.395904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.422559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab434-ef5e-445d-9861-2ae7c4625566 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.456646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.457259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.457531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.457797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.469283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.470728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-60c1d6f2-d480-454a-8345-78bd73ae5b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:05.485495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:05.486404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:05.487259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:05.487259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.487259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:05.490360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 254/504] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:05.491566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.491880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.492150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.499460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 251/505] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:05.499460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.499829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.510569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:05.512555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:05.521726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.579305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 255/506] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:05.580195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.601134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72882cdd-dd62-482d-8fd8-fe4616435582 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.640567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.641175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.641454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.641727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.642382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:05.642864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.644085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.656754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 252/507] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.656754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.691958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb629bea-92e4-4bfb-9198-9b34e9e71b15 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.728517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.729114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.729388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.729795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.730659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.731391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:05.731735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.733141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.767058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b9aa4-f25c-4140-a68a-4c70ab91f651 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.775568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 256/508] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.775568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.776772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.805484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.806213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.806643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.807003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.807740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:05.808157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.809669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.821452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 253/509] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:05.822255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.880650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14363-a562-47c2-9f4b-d44736d691a5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.913778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.914395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.914670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.914934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.922536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad142c-75dd-4525-9077-308436712080 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:05.925497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.926958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:05.941013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:05.942086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:05.943138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:05.943138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.943138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:05.943138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 257/510] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:05.943138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:05.952462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:05.960434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:05.961056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:05.961330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:05.963667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:05.972487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:05.974004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:05.988439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:05.989416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:05.990263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:05.990263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:05.990263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:05.990263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 254/511] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:05.990490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.000995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.048396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881412-50a3-4e01-b10e-05579c7855c6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.081406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.082032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.082309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.082576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.089699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def161-8c35-4275-abc2-75b583ee19fe None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.123164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.123882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.124063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.124334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.131520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.132966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:06.144870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:06.145817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 255/512] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:06.146718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.155647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.157158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.189904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.209294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.249844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744bd2d-a938-4bca-9785-b22ed91dc649 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.253876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 258/513] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:06.254705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.284064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.284679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.284953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.285218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.296253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.297716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:06.312102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:06.313188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:06.314234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:06.314234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:06.314234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:06.314234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 256/514] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:06.314505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.360550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f4a7-8bff-437f-8148-6b1c4b1b65c1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.395924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.396520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.396804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.397070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.397704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:06.398000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.399375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.406551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.410785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 259/515] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:06.411578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.420390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bc0e6-e429-4da3-b586-ec0d472bf128 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.426903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.455354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.455984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.456261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.456528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.457164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:06.457461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.458819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.470812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 257/516] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:06.471606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.514274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f1fdd-b704-46f4-837d-632ede98cad8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.549395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.549927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.550203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.550473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.551185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:06.551491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.553989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.570500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 260/517] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:06.571180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85e2cd-61a8-4f67-8f20-aac41285b320 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.571287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.609486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.610099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.610378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.610654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.621238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.623157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:06.638326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:06.639333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:06.640687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:06.640687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:06.640687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:06.640687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 258/518] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:06.640687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.642993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.646728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.676466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f622dac-757b-490e-b35d-f93f73c8fc32 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.710437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.711030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.711311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.711582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.712243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:06.712543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.713910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.725884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 261/519] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:06.726775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.743905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc484-192f-4cc1-8311-0ffb65498293 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.777388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.778005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.778280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.778546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.785263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.786696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:06.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:06.800027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:06.800890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:06.803937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 259/520] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:06.804922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.826952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577c8d-7321-420b-a627-7629449b0a71 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.856783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.861722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.862342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.862615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.862875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.865985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.869818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:06.871959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:06.882998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:06.884081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 262/521] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:06.884948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:06.905840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc18b-abfb-4d94-b91c-3687e7ced5a6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:06.939855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:06.940448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:06.940716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:06.940978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:06.987882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584a68-b848-42a0-b1d1-03d8695dd289 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.007927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.009552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.022332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.022917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.023188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.023451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.024109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.024404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.025799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.041912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 263/522] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:07.041912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.075984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.090790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.114741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 260/523] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:07.115050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.137771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a351d21-a004-4429-b607-e7bbbdb06c5b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.173183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.173782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.174058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.174328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.174960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.176416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.215906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcfcbe-15da-4a79-8fa6-80b7d3be4ff6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.249462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.250103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.250382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.250653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.251341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.251644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.253112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.269261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 264/524] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:07 2022] POST /identity/v3/users => generated 247 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:07.269839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.271372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 261/525] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:07.272245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.308591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.399262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f0c85-385a-4c38-a072-67e5197552f4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.412492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db4ba1-82a2-4f57-85a0-be97e4d44b25 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.422986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.443937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.444573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.445476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.445476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.452486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.453096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.453376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.454247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.454351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.454646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.456185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.458098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.459848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:07.472989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:07.476775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 262/526] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:07.477919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.478545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 265/527] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:07.478545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.568059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.586336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1f05-cb70-463b-b77c-8b155673fdbf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.586545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29898453-13d9-4984-a927-a7e044d24676 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.625395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.625630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.626025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.626212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.626310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.626486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.626656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.626813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.627610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.627943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.629952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.637206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 266/528] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:07.638047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.638689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.640413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:07.664318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:07.665289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:07.666166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:07.666166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:07.666166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:07.670180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 263/529] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:07.671978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.700193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.775413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364a3f-1600-49e5-91d9-1c46e9f3a972 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.815583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.816501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.816781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.817139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.817837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.818139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.818865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7805-8f1c-4984-873b-5f33a2abb571 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.819573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.839043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 267/530] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:07.840665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:07.868854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.869820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.870105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.870630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.884139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.940085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:07.950375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a2f-4d87-4d7d-9125-2a33cbf9e26b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:07.956683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.958133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:07.990056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:07.990853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:07.991225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:07.991642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:07.992393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:07.992762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:07.994341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.011296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 268/531] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:08.012967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.079234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 264/532] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:08.080130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.118504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.134951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7daae-2d95-48d3-8c88-825da7d99006 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.182617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.183223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.185081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.185366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.186102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=6b0a6b75badb4d04a7d32044d2d61af2) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:08.186406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.187859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.198411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 269/533] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/role_assignments?user.id=6b0a6b75badb4d04a7d32044d2d61af2&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:08.198411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.198656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a340a-9676-446b-889e-f0dd7b14678f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.233146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.260690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.261375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.262197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.262468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.272966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.274432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:08.300625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:08.301458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:08.302305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:08.310616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 265/534] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:08.314689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.406200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ef67-1851-4547-8dd7-ff409306daeb None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.440886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.447656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd985b-fac1-45d7-8d37-127d97859728 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.450239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.451139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.451652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.452130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.475357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.477268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.486782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.487383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.487657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.487954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.488644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:08.488944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.490359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:08.506522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:08.507424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:08.508354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:08.508354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:08.508354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:08.508513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 266/535] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:08.509388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.516210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 270/536] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:08.522344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.620658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063291-4278-4c6a-8214-2bdda25611eb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.635928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.657918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.658520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.658795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.659066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.659809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=efa91470f945469798d16d84fbe4f35d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:08.660135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.661616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.671922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 267/537] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/role_assignments?user.id=efa91470f945469798d16d84fbe4f35d&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:08.715359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dfd8e-74d0-454f-a0dd-b4e6403d39c2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.766629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.767259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.767533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.767818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:08.768466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:08.768765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:08.770166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:08.788580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 271/538] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:08.795226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:08.834296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.950096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedef39-710b-462d-a610-5adcab6edeea None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:08.997173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:08.997729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:08.998008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:08.998285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.005276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:09.006723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:09.019036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:09.019918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:09.020755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 268/539] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:09.025975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:09.181597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ceda-9d12-49dc-b63b-8f075565d491 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:09.221581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:09.233367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:09.233987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.234267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.234537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.235230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:09.235534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:09.237024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c849-5cd9-4957-b647-076990ac4af7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:09.255098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 272/540] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:09.260703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:09.373555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:09.396634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52372f-30f3-42ad-a91d-daa3ea6b2f88 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:09.431956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:09.432836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.433257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.434409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.435405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=5d03ed0ea7f443bf881a38c217f716e6) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:09.435882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:09.437470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965a62-c6a5-48c7-9702-cf2658496c6e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:09.443498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 269/541] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:09 2022] GET /identity/v3/role_assignments?user.id=5d03ed0ea7f443bf881a38c217f716e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:09.591559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b0d3-bef7-4c36-9c42-0250d16a529e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.591922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b0d3-bef7-4c36-9c42-0250d16a529e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.592102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b0d3-bef7-4c36-9c42-0250d16a529e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.593691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 273/542] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:09.598886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b0c29-0c16-46f8-9399-3e500cd5c472 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.599745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b0c29-0c16-46f8-9399-3e500cd5c472 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.603062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b0c29-0c16-46f8-9399-3e500cd5c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.628893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0a3b0c29-0c16-46f8-9399-3e500cd5c472 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:09.630447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0a3b0c29-0c16-46f8-9399-3e500cd5c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:09.708736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 270/543] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:09.982735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db83bd-6fc9-4644-9651-188a43ff9745 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.983145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db83bd-6fc9-4644-9651-188a43ff9745 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.983320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db83bd-6fc9-4644-9651-188a43ff9745 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:09.985026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 274/544] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:09.990548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:09.990831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:09.991106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.019894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:10.021074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:10.038851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db83bd-6fc9-4644-9651-188a43ff9745 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.115536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 271/545] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:21:10.271867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db83bd-6fc9-4644-9651-188a43ff9745 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:10.332345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:10.332984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.333265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.333535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.354649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:10.361011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:10.361891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:10.362696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 275/546] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:10.367853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.384149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:10.427922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.525259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:10.544984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d71717-e8e2-497b-90ca-45859956c967 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:10.582589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:10.583526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.584139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.585915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.586817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:10.587309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:10.588901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:10.598570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 272/547] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:10.604623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.660944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8bc0-ffa5-4849-9e53-d95e2a0f488d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:10.671689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:10.697886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:10.698774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.699394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.700021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.710738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:10.712836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70bac0-96cc-4eed-a5f1-61d51b3a1eaf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-523873fc-3cf3-40f0-a11f-3573097c2f69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:10.717395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:10.718552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:10.719520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:10.727119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 276/548] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:10.728570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebc34-8858-4dc3-bae1-203bf2d7e730 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.729000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebc34-8858-4dc3-bae1-203bf2d7e730 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.729415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebc34-8858-4dc3-bae1-203bf2d7e730 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.731544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 277/549] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:10.736434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebc34-8858-4dc3-bae1-203bf2d7e730 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.749393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:10.750023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.750297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.750560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.762409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:10.763884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-0a111d32-3e95-4236-87e2-620f448a7fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:10.779912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:10.781158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:10.782181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:10.782181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:10.782181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:10.782181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 273/550] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:10.782412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.782634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.782898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.806485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:10.807799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:10.852650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebc34-8858-4dc3-bae1-203bf2d7e730 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:10.861524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:10.888113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 274/551] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:10.889299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.900110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:10.901013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:10.901471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:10.901917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:10.903617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:10.904229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:10.905803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:10.922750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 278/552] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:10.928464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:10.940810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:10.997570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d55c-7b6b-49c8-b496-84b03fe04fcf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.038899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.039517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.039892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.040229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.040937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:11.041307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.043332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8971ad-7d40-4d23-8e7d-43725bba2689 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.056595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 275/553] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:11.062737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff239b-caa9-4ea0-851d-0406f58731fb None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.062737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff239b-caa9-4ea0-851d-0406f58731fb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.062737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff239b-caa9-4ea0-851d-0406f58731fb None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.064100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 276/554] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:11.064887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff239b-caa9-4ea0-851d-0406f58731fb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.078626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499868-685b-40af-9ce8-d3887745f56c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.126136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.126838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.127525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.127847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.140665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.142442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-95c7ba2e-5091-41ea-a9b7-9000851c3acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:11.157925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:11.158887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:11.159823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:11.159823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:11.159823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:11.161858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 279/555] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:11.163282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.163766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.164245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.183966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:11.185321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff239b-caa9-4ea0-851d-0406f58731fb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.185995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:11.194958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.202625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.233469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.234164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.234492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.235157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.245003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.247829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.262171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 280/556] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:11.263661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:11.266744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:11.267620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:11.268577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 277/557] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:11.269177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.391152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a4daa-802a-4897-adf6-114d68e7f7d2 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.393045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664137e6-3c82-4817-9de4-1fd68929d11c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.428112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.429055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.429546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.430016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.430837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:11.431350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.433782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.435302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.436181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.436471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.436724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.447272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 281/558] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:11.448466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.454720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:11.460648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:11.461991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:11.462837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:11.465752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.467445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 278/559] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:11.468668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.505409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.566418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1f6f-a59b-4ecb-be92-aab61ddc2e43 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.593629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b2d5-fb14-4c48-bbd4-53282fded1e6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.608699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.609432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.609711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.609966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.610688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:11.610985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.612452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.631737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.636807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 282/560] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:11.636963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.636963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.636963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.637224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.641210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.642727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:11.661423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:11.669635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 279/561] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:11.670775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.716549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.751193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35d1c-cf05-4b11-ac92-26c0191d926e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.760335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.775513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151312-2539-45a3-92b6-b6578ba36c92 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.785531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.786123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.786395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.786667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.787309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:11.787603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.788988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.796782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 283/562] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:11.797563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.811321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.811974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.812250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.812514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.822439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:11.828247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:11.829338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 280/563] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:11.830160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.898135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9bad-9d28-4214-a452-fec095803040 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.926062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:11.928790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ccf47-bb84-4ea1-a644-03ee7bfbd5bf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:11.931655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.932277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.932555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.932822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.961612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:11.962292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.962659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.962993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.963805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:11.964105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:11.966247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24b12a-7ed0-40ce-b6b8-29ef43ddbcbb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:11.983051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 281/564] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:11.984350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41460-4353-493c-8056-10df83d01e5f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:11.984636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41460-4353-493c-8056-10df83d01e5f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:11.984904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a41460-4353-493c-8056-10df83d01e5f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:11.986092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 282/565] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:11.986780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a41460-4353-493c-8056-10df83d01e5f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:11.991053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.004057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.005630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.087470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a41460-4353-493c-8056-10df83d01e5f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.105220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 284/566] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.106255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.132328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.132941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.133213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.133473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.135138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.143959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.145391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:12.160313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.161373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:12.162285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:12.162285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.162285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:12.162285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 283/567] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.162517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.208929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32acc6-fd2f-43b9-9f2f-2447c37585f1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.219721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.242581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.243200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.243469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.243729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.244442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:12.244734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.246780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b6bee-efe5-4033-a12f-e28cb2c21595 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.254752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 285/568] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:12.255996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.256222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.256500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.265354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3fd4e-5ea8-4027-861e-8aebfbca429f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.274044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:12.275234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:12.298140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.298983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.299364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.299535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.311836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.313293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:12.328033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.329054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:12.329925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:12.329925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.329925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:12.329925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 284/569] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.329925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.348118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 286/570] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:12.349049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.372593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.436520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04b52-6dad-4bbc-ad93-78a114208875 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.446590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.450946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa80ba-13b1-4ac4-8893-fad9c83c8264 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.472598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.473347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.473685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.474014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.484874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.486360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.487841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.488554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.488904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.489245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.489946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:12.490315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.491727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:12.501732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.502865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:12.503995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:12.503995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.503995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:12.508765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 285/571] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.508765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.511247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 287/572] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:12.516604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.609054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.613404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4325-0258-4c26-aa6b-9967a44a7d17 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.629292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10304c19-6162-4c33-8bc0-76897e9ee087 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.663240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.663428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.663865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.664063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.664176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.664336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.664442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.664601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.665012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:12.665311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.666677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.675304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.676758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.678902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 288/573] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:12.679688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:12.696000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.696975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:12.697846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:12.697846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:12.697846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:12.697846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 286/574] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.697846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.713973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.780871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c915-dce7-4c85-b029-92ead695dd4f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.798588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2863f3-4418-4afd-acce-8986e9d9ddba None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.814399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.814993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.815271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.815538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.816198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:12.816498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.817869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.829005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 289/575] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:12.829815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.831654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.832310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.832589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.832749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.832844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.840994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.842444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:12.854003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.854981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 287/576] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.856487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.924674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:12.937212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72bd-5bbf-48ed-bb84-c7dd99983920 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.954714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358b76-195e-467b-b1ca-531b0a8d1bf6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:12.970347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.971007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.971284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.971551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.981801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:12.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:12.987761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:12.988627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:12.989247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:12.989343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 290/577] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:12.989412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:12.989412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:12.989412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:12.989583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:12.997204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:12.998742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:13.009841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:13.010733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:13.012405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 288/578] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:13.012905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.053713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.092280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8413b-7820-4638-886a-6c192c977335 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.109516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7b87-82ca-40f3-b9fc-c10029158b32 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.126174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.126768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.127043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.127310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.127968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.128267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.129620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.138221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.141263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 291/579] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.142054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.147365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.148029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.148303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.148567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.156074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.157504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:13.169136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:13.170101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 289/580] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:13.170984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.245257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6ba5-ef18-4d4c-bcb7-359370ef91d6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.268346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.269254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079054c-8528-4d9a-ae2b-7a7441b92ab4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.280049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.280650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.281099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.281205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.281889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.282191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.283618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.301768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 292/581] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.302582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.304374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.304986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.305270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.305542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.306205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.306508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.307919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.319049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 290/582] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.320739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.376470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.401275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfa16-0882-4d0f-a792-6728395b63fa None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.422733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a8fa-0e07-4bcc-bba8-90636d50e13d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.435902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.436503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.436777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.437045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.437723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.438024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.439467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.450577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 293/583] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.451357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.460089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.460708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.460981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.461245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.469162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.470591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:13.482284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:13.483266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 291/584] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:13.484276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.502468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.560464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce6f7-378b-41af-8107-1cbbe1bc7e43 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.582311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef0a3d-3b72-4fb2-a301-2cea849f3d1c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.594658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.595124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.595407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.595684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.598455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.598572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.598572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.598572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.610882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 294/585] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.611692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.616039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.616625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.616907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.617178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.627865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.629342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:13.643673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:13.645252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:13.646324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:13.646324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:13.646324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:13.646324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 292/586] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:13.646603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.735587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.739020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffc9-c9be-4a94-854b-556e85356e77 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.752378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da559-8cd7-460e-9670-6506f84710ee None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.774297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.774846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.775120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.775386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.785707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.785866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.786345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.786622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.786892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.787297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.801273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=1b0807da1ad345eb9de13973cae6bfd8, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:13.802033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:13.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:13.804146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:13.804146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:13.804146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:13.804316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.804401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 295/587] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:13.804401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.862641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 293/588] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:13 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:13.863460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.883113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:13.914339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419ffd-5e91-4cd2-8178-4ff52eb7bb7c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.954189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:13.954800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:13.955070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:13.955337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:13.956131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:13.956428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:13.957870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:13.982121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 296/589] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:13.982121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:13.982439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0a23f-6860-445a-bf73-b1bf0dc577b6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:13.994766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.026163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.026702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.027027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.027305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.028149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=21315db813dc407d8b0577065110be44) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.029089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.030380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.039505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 294/590] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/role_assignments?user.id=21315db813dc407d8b0577065110be44&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.040532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.108471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdb9d-7f77-473b-9c84-309f77cf677a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.148634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.149255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.149536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.149799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.150506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.150817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.152777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.168713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.169043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 297/591] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.174556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.198203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242166e9-78ee-460e-ad1d-0eff8d2b4782 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.237080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.237697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.237957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.238224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.238862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.239166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.240602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.253917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 295/592] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.254752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.280228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.302070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982d036-6967-4de2-9787-56783cf3dfc1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.339294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.340732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.341053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.341286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.354522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.356219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:14.375975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:14.376989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:14.377943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:14.377943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:14.377943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:14.379924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 298/593] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:14.380968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.394282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d8d6-4c4b-4150-85ec-d929a0f8a887 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.441573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.442729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.443016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.443289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.453885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.455683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.458913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:14.468844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:14.476451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 296/594] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:14.477392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.510502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef2ef-2af5-40d5-9846-7cd7f24a3617 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.541340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.559051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.560196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.560664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.561116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.571975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.574575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:14.591645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:14.592646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:14.593617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:14.596882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 299/595] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:14.597914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.603704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8120d6-9390-4ccf-8afc-62503f88c2b0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.645231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.645957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.646302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.646644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.647351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.647809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.649274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.667020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 297/596] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.667020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.734525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.748623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b423f4-66de-417a-ad87-3df6836959f4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.780796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733213f-a64c-4c4f-aa41-fe71f684e8f2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.794719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.795889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.796847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.797595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.798770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.799282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.801305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.817294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:14.817894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:14.818172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:14.818442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:14.823472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:14.823472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:14.823472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:14.826282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 300/597] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.826406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.848610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 298/598] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:14.848610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:14.912190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:14.961676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc64317-7cfc-4ecf-b9c1-9a5f340b4fde None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.974864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea53db-1337-44c9-902c-98fdc9edbf4a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:14.983360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:15.005086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.005810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.006092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.006359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/6b0a6b75badb4d04a7d32044d2d61af2/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.022198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=6b0a6b75badb4d04a7d32044d2d61af2, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.023574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.029552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.030184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.030464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.030735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.037813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.039283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:15.052625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:15.053525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:15.054425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:15.059176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 301/599] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:15.060035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.095504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 299/600] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:14 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/6b0a6b75badb4d04a7d32044d2d61af2/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:15.096776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.226826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd130-7f7a-4b24-9c07-fa5f3b325b07 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.235382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816938d-291b-4bc0-a34a-c2054e001fcc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.237205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:15.270641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.271624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.272206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.272679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.274081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:15.274594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.276346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.294265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 300/601] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:15.304327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.318961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.319615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.319931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.320206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.336105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.337703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:15.355810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:15.356835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:15.357724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:15.357724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:15.357724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:15.357892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 302/602] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:15.363731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.385817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:15.485468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61938cfd-f3bb-465f-9c9d-5cff5804f1ae None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.505922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296352da-8992-4f06-8da1-2faecfc3e2a6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.528135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.529049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.529335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.529604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/efa91470f945469798d16d84fbe4f35d/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.548026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=efa91470f945469798d16d84fbe4f35d, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.549462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.551014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.552337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.553212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.553746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.554752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:15.555090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.556800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.575510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 303/603] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:15.581526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.601750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:15.657851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 301/604] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:15 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/efa91470f945469798d16d84fbe4f35d/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:21:15.717995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70fd38-65a6-4064-84f6-47bff482a421 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.760740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.761963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.762672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.763130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.771799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.773678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:15.787471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:15.788490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:15.789380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:15.791730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 304/605] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:15.798860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:15.903698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:15.929953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7f-cc16-436b-b7d6-5cad0c3268db None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:15.969078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:15.969692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:15.969969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:15.970238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:15.970924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:15.971224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:15.972715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafa6b0-b10e-4d34-a790-e44cdddf2dfc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:15.989536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 302/606] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:15.996536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:16.079923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.105719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6445e9-345d-40fb-bff9-550f72186ba7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.106030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6445e9-345d-40fb-bff9-550f72186ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.106327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6445e9-345d-40fb-bff9-550f72186ba7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.107652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 303/607] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:21:16.108490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efbd91-4045-4718-bbc0-25f301a4a25a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:16.116227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e32fd-7bcd-47bb-9681-3cc46121df3b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.116499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e32fd-7bcd-47bb-9681-3cc46121df3b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.116777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e32fd-7bcd-47bb-9681-3cc46121df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.141218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-053e32fd-7bcd-47bb-9681-3cc46121df3b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:16.142416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-053e32fd-7bcd-47bb-9681-3cc46121df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:16.151460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:16.153323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.154306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.154789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/5d03ed0ea7f443bf881a38c217f716e6/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.175045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=5d03ed0ea7f443bf881a38c217f716e6, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:16.177456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4174a-058f-471f-a1e5-fbc49aeb782b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:16.220067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 304/608] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:16.261229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 305/609] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:15 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/5d03ed0ea7f443bf881a38c217f716e6/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:16.306144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90b2f-372b-49bf-bd71-49e0c0de4dbb None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.306723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90b2f-372b-49bf-bd71-49e0c0de4dbb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.307222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90b2f-372b-49bf-bd71-49e0c0de4dbb None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.310059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 305/610] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:16.320106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.320383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.320657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.349692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:16.350907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:16.442160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 306/611] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:16.531938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f90b2f-372b-49bf-bd71-49e0c0de4dbb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:16.607526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.644602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f90b2f-372b-49bf-bd71-49e0c0de4dbb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:16.684761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:16.685394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.685657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.685926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.700597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:16.705172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:16.706085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:16.707099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 306/612] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:16.714164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:16.755195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:16.805868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.858151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290030-78a3-4bfb-a8d6-2463f23b9978 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:16.877090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6a19f-6494-429c-9ef7-0d27d7ba2723 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:16.907865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:16.908736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.909305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.909722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.910601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:16.911046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:16.912734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:16.913155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.921866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:16.922419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:16.922699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:16.930254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:16.931037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 307/613] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:16.934351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:16.937989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:16.939272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:16.940424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:16.941405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 307/614] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:16.946879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.059583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ea4d8-5aab-4126-92db-580f86d32574 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.090641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.091257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.091539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.091837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.092508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:17.092813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.094172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.103617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 308/615] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:17.109603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.165006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.171505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1646e-d456-4fc3-aadf-7023033283f4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.207481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.217750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcc37-fccc-43b6-bdee-216beb91e9e4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.240517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.241241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.241585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.241919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.253846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.254475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.254754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.255021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.261067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.263161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.268178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.269617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:17.284465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:17.285474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:17.286368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:17.286368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:17.286368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:17.286368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 309/616] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:17.294095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:17.295019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:17.295989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:17.295989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:17.295989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:17.296159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.296231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 308/617] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:17.303146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.418393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89b4f-39b8-4168-a338-b6e52ca6314b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.436164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.453621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.454243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.454523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.454796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.455439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:17.455743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.457214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.470896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 310/618] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:17.476533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.583158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02838d-17f1-41a4-91d8-ff330ba65f89 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.610868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463354d4-16d9-4861-a12f-d286d1f74e30 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.621140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.621973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.622276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.622614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.630562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.632197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2355b3ef-23a2-4299-90ad-0b07e451d2b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:17.645901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:17.647069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:17.648283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 311/619] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:17.649014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.651890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.651890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.651890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.651890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:17.651890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.655548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31e1c0-db7b-41db-8663-fd631e412526 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.655673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab38f-9b14-4812-a368-96f6eff0cc8f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.655673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab38f-9b14-4812-a368-96f6eff0cc8f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.655673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab38f-9b14-4812-a368-96f6eff0cc8f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.655913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 312/620] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:17.656590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab38f-9b14-4812-a368-96f6eff0cc8f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.666500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 309/621] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:17.667989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.668365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.668792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.684913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.689351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:17.691222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:17.722373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.770890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 310/622] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:17.779806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab38f-9b14-4812-a368-96f6eff0cc8f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.780471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.809202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.809852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.810134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.810400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.811421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:17.811552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:17.813245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:17.835071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 313/623] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:17.843818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:17.929875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:17.950520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb713ee-69bd-4414-b98a-a82b5947fc97 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:17.986672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:17.987311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:17.987682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:17.987991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:17.999865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.000006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845ee1a-014a-4874-8091-6311305e2546 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.001526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:18.016614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:18.017607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:18.018896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:18.018896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:18.018896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:18.018896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 314/624] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:18.023676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.073205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.074003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.074505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.074899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.092998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.094575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:18.116851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:18.117855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:18.119376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 311/625] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:18.124657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.130905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eb82c-2f08-448b-a896-1b42d50234a2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.166492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.167100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.167383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.168357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.168979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:18.169283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.170677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.173587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.173991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.184766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 315/626] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:18.189982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.260691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7462a-cb17-4615-92fd-281fe0ca5a86 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.298503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.299112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.299398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.299665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.300427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:18.300735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.302257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.305402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f5ac4-79ed-4b89-951e-d1cc5270204c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.324915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 312/627] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:18.324915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.351594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.352392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.352869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.352979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.364540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-038f6508-4ffe-4d13-a926-bdaa53afa8db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:18.369631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:18.370548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:18.372036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 316/628] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:18.373379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1f246-d567-45b6-9e4e-8aa509e93180 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.373379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1f246-d567-45b6-9e4e-8aa509e93180 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.373379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1f246-d567-45b6-9e4e-8aa509e93180 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.374853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 317/629] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:18.375425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1f246-d567-45b6-9e4e-8aa509e93180 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.413025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.436558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40286fe-edb1-4860-9efe-38afcd18854e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.438418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.475460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.476558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.477020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.477469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.484694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.486267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.496548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1f246-d567-45b6-9e4e-8aa509e93180 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:18.498610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:18.499515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 313/630] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:18.501042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.538251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.539932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.540215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.540483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.613056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5e9f-a95d-4a80-8c7c-118e169dc169 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.616865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.618329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.658080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.658686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.658961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.659229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.660178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:18.660357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.661946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa0b85-a7a2-43fe-b9fe-90a69008ee10 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.664701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.676628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 314/631] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:18.678688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.678792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.678792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.678792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.693059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:18.694135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:18.729744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 318/632] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:18.730955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.768141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 315/633] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:18.769282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.832624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d88fd-75fb-414b-996b-5616078a1058 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.868805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.869735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.870013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.870282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.871503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:18.871822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.873236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1832-c529-4f06-99a3-5608c2c88f8f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.882109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cb1f-6af0-4af7-8ece-0bc9f9a6e129 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:18.885010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 319/634] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:18.889113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d074b5d-4f6e-4e50-9266-841d7e833d46 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.889473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d074b5d-4f6e-4e50-9266-841d7e833d46 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.889837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d074b5d-4f6e-4e50-9266-841d7e833d46 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.891702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 320/635] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:18.892517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d074b5d-4f6e-4e50-9266-841d7e833d46 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:18.908920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.912226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.920626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:18.921234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:18.921505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:18.921768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:18.931732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:18.938880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:18.947881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:18.949468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:18.950561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:18.950561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:18.950561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:18.952144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 316/636] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:18.953161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.004409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d074b5d-4f6e-4e50-9266-841d7e833d46 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.042155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.043513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.044069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.044355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.054246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.055667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.061448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496becf0-049d-473f-8663-a18416c44d8e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a9fe306d-647c-4fec-8e85-bb9a31675c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:19.069781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:19.070896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:19.072200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:19.072200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:19.072200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:19.072200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 321/637] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:19.072490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.072570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.072837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.090544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:19.091706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:19.097620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.098270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.098548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.098823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/21315db813dc407d8b0577065110be44/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.113999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=21315db813dc407d8b0577065110be44, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.115430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.148641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.157024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 322/638] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:19.157894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.210055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 317/639] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:18 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/21315db813dc407d8b0577065110be44/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:19.210969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.247136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.281579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89d265-6cce-42a8-8257-1cdc377e9cde None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.332031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.332779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d01e5-67bf-4542-bf3d-59c6f4f309f4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.332903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.333274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.333646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.334647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:19.335052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.337267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.357906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 323/640] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:19.359196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.383067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.383727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.384038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.384299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.396058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:19.400745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:19.402002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 318/641] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:19.403310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.436478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.489687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5054e-be2e-41ff-ac9d-e3e4a90c2050 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.509127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.518763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b97c6-4a45-4558-9ab2-82a188aeb61c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.526416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.527052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.527328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.527776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.528440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:19.528739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.530087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.542112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 324/642] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:19.543767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.564084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.564814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.565092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.565360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.573931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.575846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:19.588126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:19.589165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 319/643] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:19.590121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.663185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10d19-5080-4bde-a11b-b4918e327425 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.681537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.701471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f9bc0-5245-4428-8adc-1f8f5c90c9fc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.707408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.708314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.709280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.709763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.711005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:19.713059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.715367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.729345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 325/644] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:19.731018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.736992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.737627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.737903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.738174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.749827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:19.754896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:19.755913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 320/645] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:19.756891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.770893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.849255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9cf55-cee6-4925-bfc3-034b54df8c71 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.862658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09c2d-ebfa-4817-8781-b3c92753ea3d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:19.885465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.886091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.886978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.887327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.895570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.897180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.899749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:19.900404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:19.900682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:19.900947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:19.901667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:19.901998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:19.903441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:19.908680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:19.909544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:19.910426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 326/646] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:19.910937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.927511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 321/647] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:19.929263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:19.951299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:19.999701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.019109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b3fd-4ebd-46fa-92ba-ecff3c86d738 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.032203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ee09-60e2-4c4b-899d-02fc1a6bac7b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.053950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.054571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.054848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.055117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.065574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.066959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.067095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.067553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.067847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.068114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.068762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:20.069054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.070393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.082526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 322/648] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:20.082526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:20.082734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:20.083601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:20.085215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:20.085215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.085215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:20.085215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 327/649] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:20.085215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.180050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.190420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71c87-4917-4bdd-9447-b55949a38ff9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.193227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79a0-14ed-414e-a9ba-072b8a55ae1f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.221048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.227427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.227587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.228063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.233894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.234022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.234111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.234184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.234253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.234253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:20.234253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.234253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.249618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 323/650] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:20.249618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.312210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.313661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.363600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb2b3-bfb9-47fb-9da4-650c3d333424 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.398888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.399508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.399816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.400068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.403942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.413863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.415373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.416295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 328/651] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:20.417156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:20.432117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:20.433771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:20.439634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:20.439634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.439634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:20.439634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 324/652] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:20.439634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.484213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.528921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063488d0-df5d-4162-900f-22ff73c3fc69 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.541666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cd5c7-7d59-4597-9721-dd6496e6c71f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.564166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.564806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.565080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.565348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.565977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:20.566274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.567885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.575885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.576487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.576763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.577023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.577739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:20.578043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.579454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.584705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 329/653] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:20.584705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.589471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 325/654] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:20.599940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.647540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.717555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339894b-1d74-418c-b3f4-4c364705e085 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.724832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf32c-e7be-4958-9598-dfebd382f817 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.726267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.756765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.757378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.757655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.757926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.759836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:20.759836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.762210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.775911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.776737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.777765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.778032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.778284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 326/655] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:20.779701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.794155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.796103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:20.814800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:20.815963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:20.816987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:20.816987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:20.816987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:20.819434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 330/656] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:20.820418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:20.919686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994e8e9-675f-469d-a6a7-8aa2e87597c3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.943112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:20.946884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce17c-98fe-4124-9dc6-397b60d154ef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:20.968538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.969480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.969762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.970040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.981477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.983770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:20.989351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:20.990161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:20.990708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:20.990975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:20.996734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:20.997763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:20.998692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:20.999224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:20.999303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 327/657] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:21.000021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.000121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:21.017231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:21.018215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:21.019173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 331/658] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:21.024091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.037238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.123018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2467f-481e-4daa-b822-aeba01422d63 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.160044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.160654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.160986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.161200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.161844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:21.162144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.163521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.163812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099371-892f-4db4-87c6-b239eb1d1e34 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.181784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 328/659] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:21.182547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.207010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.208259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.208679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.209121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.210043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:21.210536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.212602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.232302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 332/660] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:21.233984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.255803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.285754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.302324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0a03-8182-4cfe-8bc8-d212cd80483b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.339208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.340437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.340734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.341048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.341688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:21.341987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.343419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d1ecb-c471-40f5-81de-8cf2d5aabbe1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.352470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599b35c-1309-43ef-9d1c-d1fb6d2508c1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 329/661] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e0d2-8ded-4d7b-8714-a4f0635363e9 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e0d2-8ded-4d7b-8714-a4f0635363e9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e0d2-8ded-4d7b-8714-a4f0635363e9 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 330/662] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:21.365731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e0d2-8ded-4d7b-8714-a4f0635363e9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.396461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.397011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.397288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.397549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.408835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.410791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:21.423391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:21.424590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 333/663] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:21.426089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.482638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e0d2-8ded-4d7b-8714-a4f0635363e9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.510351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.520791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.521642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.522103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.522583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.533022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b819-8479-4901-8d50-087e7da886d1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.538153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.569605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.570237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.570513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.570781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.600017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.601736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb39c1-8c3c-4b39-87db-5c1c72e992ae None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.649875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.651250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.718295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 331/664] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:21.718295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.718295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.718295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.735600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:21.736849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:21.744604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.766837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 334/665] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:21.767862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.789145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.818782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 332/666] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:21.819616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.898202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352e070-fb72-477c-9ab0-befd695e0ad5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.934539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.935147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.935497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.935790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:21.936489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:21.936792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:21.938208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:21.947332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dbc1a-0313-4f5b-a082-8fbc30afce8d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:21.950451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 335/667] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:21.951464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:21.993180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:21.993911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:21.994949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:21.995224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:21.996014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.009945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.012273 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:22.035604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:22.036610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:22.037519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:22.037519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:22.037519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:22.037519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 333/668] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:22.038105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.073746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afd85-b977-4030-92b6-52243bb04adc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.076015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.112377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.113053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.113348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.113599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.125586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.127025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:22.144044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:22.145013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:22.145927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:22.145927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:22.145927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:22.145927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 336/669] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:22.146161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.160020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6b88f-8962-4640-b385-a76df41a4612 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.201685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f081-680d-4830-a023-671986203247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.202204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f081-680d-4830-a023-671986203247 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.202512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f081-680d-4830-a023-671986203247 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.202783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61f081-680d-4830-a023-671986203247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.203503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61f081-680d-4830-a023-671986203247 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=6b0a6b75badb4d04a7d32044d2d61af2) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:22.203830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61f081-680d-4830-a023-671986203247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.205256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61f081-680d-4830-a023-671986203247 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.219828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 334/670] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/role_assignments?user.id=6b0a6b75badb4d04a7d32044d2d61af2&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:22.219828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f081-680d-4830-a023-671986203247 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.268924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eb3e7-07a2-4599-99dd-7e1887dfc999 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.272133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.307667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.308511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.309022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.309436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.310307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:22.310677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.312167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.332302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 337/671] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:22.333425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.354489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.368299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61f081-680d-4830-a023-671986203247 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.422317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.423051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.423390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.423658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.436729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:22.441395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:22.442395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 335/672] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:22.443981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.462356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18d18-968d-4fc3-96a0-8f5839ae4a5f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.507643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.508280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.508558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.508830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.509467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:22.509770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.511146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.528704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 338/673] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:22.530131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.547521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.568284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6812c49-6f04-4d72-ab41-db08d739b26f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.607074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.607907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.608187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.608483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.616070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.617761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:22.630697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:22.631905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:22.632814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 336/674] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:22.633360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.647846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.654835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195bf1-18f2-41ea-8c3f-e091d8c3f0ef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.705947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.706896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.707564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.708031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.709387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:22.709985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.711494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.723585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 339/675] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:22.725463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.754829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872ab9-bfd3-47cc-a9ea-bef02a8368bb None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.795740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.796423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.796657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.796928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.804034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.805482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.809480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:22.818838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:22.823718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 337/676] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:22.825416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.843927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4dcf8-7ef6-43f5-98a5-90939f943a3c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.879757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.880388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.880667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.880937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.881615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:22.881916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.883330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48d440-b6af-40c1-822c-035391d7cca2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 340/677] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d447fd-1bcb-4993-ae06-2ab56b743db8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d447fd-1bcb-4993-ae06-2ab56b743db8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d447fd-1bcb-4993-ae06-2ab56b743db8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 341/678] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:22.901432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d447fd-1bcb-4993-ae06-2ab56b743db8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:22.919425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:22.951624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25099e4-ff66-48c4-865f-3689ed784e0d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:22.986161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:22.986705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:22.986978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:22.987247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:22.998484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:22.999966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:23.014637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:23.015642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:23.016983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:23.016983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:23.016983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:23.016983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 338/679] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:23.016983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.022424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d447fd-1bcb-4993-ae06-2ab56b743db8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.054503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.060022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.060627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.060907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.061180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.061925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.062272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.063656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea969cc-130e-4555-b4f5-f64ec3345649 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.075641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 342/680] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:23.076779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.077061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.077332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.096083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:23.097748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:23.126859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66c58-4dad-4d13-bc55-61a902db6404 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.151887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.164771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.167047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.167047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.167047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.167047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=efa91470f945469798d16d84fbe4f35d) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.167047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.169047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.170844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 343/681] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:23.172380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.180041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 339/682] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/role_assignments?user.id=efa91470f945469798d16d84fbe4f35d&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:23.180041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.364471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94e68-5f9c-4eba-a85d-54a12b724d7d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.377752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb93c-5a36-43d7-8b14-ee81ab2a22b9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.396655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.412159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.413422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.413847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.414271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.415057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.415500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.416871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.417321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.417783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.418196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.418539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.419300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=5d03ed0ea7f443bf881a38c217f716e6) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.419673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.421618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.428887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 340/683] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/role_assignments?user.id=5d03ed0ea7f443bf881a38c217f716e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:23.432521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 344/684] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:23.438894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.503818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.507955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.564064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03d7b-762c-45ba-9f39-bf615de4b1b4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.604017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.607410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.607410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.607410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.615635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.618256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.630029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247feb8f-98da-4306-acb3-41d3c5ebcfd2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:23.635307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:23.637468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:23.638669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 341/685] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:23.643597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.681294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.682169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.682595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.683167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.694824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:23.700760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:23.701718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:23.702590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:23.704997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 345/686] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:23.710872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.761008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.771903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7418c-0937-4241-9a36-11a96e95018d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.787629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:23.821944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.822546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.822774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.823021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.823982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.824743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.827366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.837090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79851a-18d1-4c25-a61f-af99cb564e01 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:23.860235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 342/687] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:23.868774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:23.889964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:23.890624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:23.890908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:23.891179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:23.891869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:23.892176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:23.894309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:23.908266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 346/688] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:23.909562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.022886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7714-7cdf-4db8-a6a4-4cead572e6a5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.025607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:24.078929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.079641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.080054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.080425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.093315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.094965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.111337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f71a-0ee4-43b0-8aca-48b296634a2d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:24.118025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:24.119211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:24.120350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:24.120350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:24.120350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:24.128043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 347/689] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:24.133895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.154237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.155130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.155569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.156021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.197609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:24.243096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.244975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1121-2063-4b2b-85ba-0850320aa738 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.347227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede599a-33b4-4cd5-ab54-4b5123c40128 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.387656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.388634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.389067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.389527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.390349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:24.390797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.392344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.407018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 348/690] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:24.412385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.440196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:24.544725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70edcf3-d8c5-42fc-99de-c2cf9ca184c5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.578479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 343/691] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:24.580492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87e31-075e-4882-9e1b-7b45ae0c13ea None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.580957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87e31-075e-4882-9e1b-7b45ae0c13ea None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.581399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87e31-075e-4882-9e1b-7b45ae0c13ea None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.583321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 344/692] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:24.584558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87e31-075e-4882-9e1b-7b45ae0c13ea None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.594656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.595297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.595572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.595855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.606422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.608461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-852cd212-8598-41bc-9415-b8f29c032255 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:24.624811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:24.626056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:24.627129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 349/693] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:24.627738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.627738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.628033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.648790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:24.650187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:24.669968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:24.709874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87e31-075e-4882-9e1b-7b45ae0c13ea None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.731871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 350/694] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:24.732816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.744828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:24.753295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.754485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.754960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.755376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.768891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.770523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:24.789897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:24.790903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:24.791824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:24.791824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:24.791824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:24.791824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 345/695] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:24.797521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:24.901398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e6f8-50f2-44c4-b565-424c2d0beb10 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:24.940752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:24.941366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:24.941700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:24.941976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:24.942700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:24.943000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:24.944567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:24.971592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 351/696] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:24.984599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.027540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2191c3-edf9-4c35-bce0-624703e4d630 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.060714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.079219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.079842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.080125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.080393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.081140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:25.081443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.081901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.083719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.095532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 346/697] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:25.096467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.128371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853adc-5559-4f02-b3f4-fa4aa10e8a21 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.164868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.165542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.165819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.166084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.217100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce80b5-d749-46c2-b2f1-7194db2aa27d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.257595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.258498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.258952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.259366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.272546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.274350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:25.290560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:25.291821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:25.294016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:25.294016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:25.294016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:25.297003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 347/698] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:25.298062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.335136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.368902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.371184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.409916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762195-51b5-49a1-85f5-9d29cabcdf91 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.442042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.447873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.449120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.449637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.449909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.457651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.459032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:25.471622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:25.472853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:25.473919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 348/699] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:25.474705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.491640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 352/700] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:25.492830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.571905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.581646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712fa7f-7fe7-4a49-894e-68515dbdb2a8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.610798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b9d29-31dd-44d5-af53-b076ae04e749 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.619284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.619740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.620048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.620322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.621813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:25.622192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.623732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.635939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 349/701] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:25.637332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.653720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.654864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.655396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.656055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.657850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:25.658644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.660566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.676943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 353/702] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:25.678592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.707576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.746010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92f23d-67db-45b0-82c7-6637ef9cac01 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.785184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.786102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.786383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.786919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.794207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1d90e-c128-4613-95f4-a9e6a58102bf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.802369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.804333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:25.825704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:25.827019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:25.828094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:25.828094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:25.828094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:25.828094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 350/703] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:25.828094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.832142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:25.832576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.833187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.833460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.833725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.834355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.835769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70c1d-5df9-41e2-991f-af54c0f66125 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.928003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c63bc-242f-4449-b9b4-3acd5718b301 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:25.930619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 354/704] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:21:25 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:25.932063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ac89-6201-4353-a1b1-a32add434c40 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ac89-6201-4353-a1b1-a32add434c40 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ac89-6201-4353-a1b1-a32add434c40 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 355/705] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026e1a-e015-4123-a3a3-ef6dcab92df0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026e1a-e015-4123-a3a3-ef6dcab92df0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026e1a-e015-4123-a3a3-ef6dcab92df0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.938749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 356/706] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:25.939230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026e1a-e015-4123-a3a3-ef6dcab92df0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:25.975341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:25.975905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.976187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.976499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:25.977224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=21315db813dc407d8b0577065110be44) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:25.977874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:25.979015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d593732-953e-47ff-86aa-75df834d513d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:25.987395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 351/707] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/role_assignments?user.id=21315db813dc407d8b0577065110be44&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:25.988563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef03e-008d-4397-bc99-6e47efad089a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:25.988853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef03e-008d-4397-bc99-6e47efad089a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:25.989129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef03e-008d-4397-bc99-6e47efad089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.016428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1cbef03e-008d-4397-bc99-6e47efad089a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:26.018357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1cbef03e-008d-4397-bc99-6e47efad089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:26.051975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.076534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026e1a-e015-4123-a3a3-ef6dcab92df0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.125844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.128276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.129017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.129263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.129900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.130871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:26.131752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.138101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 352/708] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:26.143363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.143478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.143478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.143478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.150524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 357/709] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:26.155298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:26.156172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.156744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:26.247532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 353/710] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:26.287031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c040-5dfb-4762-81c0-05a31c426657 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.328872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.329510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.329784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.330050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.337617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.339042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.341679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:26.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:26.352283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:26.353418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 358/711] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:26.358956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.440009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.481086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ea5e-629b-4e36-b624-a516a8c3e4fc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.538057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.560263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.562926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.562926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.562926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.562926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:26.562926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.565243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.575039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bae093-6f76-4d39-8b04-4c228451e14d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.578874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 354/712] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:26.579509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.630539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.631329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.631731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.632640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.633334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.635327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:26.653535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:26.654792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:26.655655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:26.657218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 359/713] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:26.658292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.699486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec37c-0066-4414-9a2a-44698da42734 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.743316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.744249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.744534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.745242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.745750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.747314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.749249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:26.765673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:26.768280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:26.769136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 355/714] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:26.769920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.789096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ece86-b8c6-4f2f-bad2-cee9bd9a58d9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.826610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.827264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.827549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.827854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.828745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:26.829055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.830482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.842644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.843275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 360/715] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:26.845129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:26.918808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35a53-08d6-473a-903c-1a374c8850ce None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.963758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe390-990e-47b8-b646-1131f689e4aa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:26.986027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:26.986706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:26.986980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:26.987247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:26.988177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:26.988286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:26.989607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:26.995458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:26.995647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 356/716] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:27.005606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:27.006236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:27.007096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:27.007582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:27.008511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:27.009775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:27.012691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:27.014534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:27.025988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 361/717] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:27.032532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:27.169399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1a18-db6e-4126-bb75-57cf19d94a5e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:27.174047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6cbd-5f7c-4e52-b907-0795b2e693e5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:27.205641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:27.206667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:27.207177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:27.207711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:27.208255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:27.209410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:27.209904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:27.211456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ff009-3d9b-47d6-9e7d-01670d99d3fd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:27.218359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 362/718] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:27.242691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:27.243326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:27.243602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:27.243909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:27.244560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] RBAC: Adding query filter params (type=network) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:27.244861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:27.246464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32d7c-4cf4-46c6-96e0-ea67ad7b7698 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:27.258045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 357/719] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:28.178910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0883f2-a680-47c3-aa92-9e02a5acf7a8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.179424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0883f2-a680-47c3-aa92-9e02a5acf7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.179424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0883f2-a680-47c3-aa92-9e02a5acf7a8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.181042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 363/720] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:28.186878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813271-f39a-4335-a166-e7356ce85695 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.187279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813271-f39a-4335-a166-e7356ce85695 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.187461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813271-f39a-4335-a166-e7356ce85695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.206127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c8813271-f39a-4335-a166-e7356ce85695 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:28.207321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c8813271-f39a-4335-a166-e7356ce85695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:28.279561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 358/721] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:21:28.535029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a259d9-7f59-4c3d-8af0-0819c71426b4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.535368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a259d9-7f59-4c3d-8af0-0819c71426b4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.535536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a259d9-7f59-4c3d-8af0-0819c71426b4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.537109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 364/722] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:28.546018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.546308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.546585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.568207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:28.569443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:28.627167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a259d9-7f59-4c3d-8af0-0819c71426b4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:28.644782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 359/723] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:28.708918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:28.756262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a259d9-7f59-4c3d-8af0-0819c71426b4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:28.792738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:28.793287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.793564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.793831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.809789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:28.815201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:28.816230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:28.817090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 365/724] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:28.822547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:28.896314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:28.958305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819810f-5241-4f3d-8057-91dae0832838 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:28.993544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:28.994161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:28.994442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:28.994714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:28.995927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:28.996368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:28.998041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.006746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 360/725] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:29.016868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.021556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.129508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965a91-3405-4f2b-82f5-66b0aaa2652c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.166529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.167171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.168156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.168611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.174992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27311ae-27d5-4c15-bcb2-07c5a695f99e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.180104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:29.186418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:29.187852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:29.188719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:29.190388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.194615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 361/726] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:29.194615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.205497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.246685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.247430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.247720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.248017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.271771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.273523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:29.304392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:29.305552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:29.310285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:29.310285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:29.310285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:29.310285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 366/727] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:29.312728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.338503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774a35-e9bd-47b3-ba37-b31db0543bd9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.375804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.376416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.376761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.377038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.378034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:29.378411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.379887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c76de6-b447-48cf-a357-c395c108e946 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.389065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 362/728] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:29.390296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dffe56-2789-4f21-ac1b-eb4d1ce5bc2d None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.390563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dffe56-2789-4f21-ac1b-eb4d1ce5bc2d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.390836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dffe56-2789-4f21-ac1b-eb4d1ce5bc2d None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.396828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 363/729] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:29.397654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dffe56-2789-4f21-ac1b-eb4d1ce5bc2d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.426623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.461353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cee24-f6b2-4915-83e3-d478cb5ea98e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.497650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.498218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.498497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.498771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.499419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:29.499720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.501192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252e64-1947-48c5-8bfb-282c9cca7ae6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.510143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dffe56-2789-4f21-ac1b-eb4d1ce5bc2d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.519128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 367/730] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:29.520487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.520774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.521050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.540513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:29.541776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:29.547052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.547686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.548002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.548325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.559984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.561614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.566796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:29.580179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:29.581675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:29.582631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:29.582631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:29.582631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:29.584257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 364/731] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:29.585210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.617468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 368/732] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:29.618387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.678794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.695465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284555-b326-4f32-bf98-603b84b9e2ba None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.733985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.734956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.735490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.735966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.743969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.745712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:29.758159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:29.759127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:29.760107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:29.763056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 365/733] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:29.771055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.789306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132abb9-d872-4ce1-a293-36736792bb53 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.843935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.844577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.844835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.845106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.845751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:29.846053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.847425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c055ef-d845-46d0-bb0e-e0b6cbcc8e51 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.863887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 369/734] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:29.863887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bf58-a2ca-4492-b5f3-b37417f65e1c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.863887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bf58-a2ca-4492-b5f3-b37417f65e1c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.863887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bf58-a2ca-4492-b5f3-b37417f65e1c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.863887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 370/735] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:29.864332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0100e-b8fd-4b33-b78b-d1a46b80201e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.864699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0100e-b8fd-4b33-b78b-d1a46b80201e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.864802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0100e-b8fd-4b33-b78b-d1a46b80201e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.866027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 371/736] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:29.866658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0100e-b8fd-4b33-b78b-d1a46b80201e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:29.887354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.923974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfc6fa-e208-4cb9-81da-6a9e8610ff07 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.961123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:29.961770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.962052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.962483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:29.963212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:29.963573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:29.966150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3914-6d1d-4bdd-9be5-a5b26c573b88 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:29.969363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:29.974004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0100e-b8fd-4b33-b78b-d1a46b80201e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:29.985947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 366/737] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:29.987242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:29.987529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:29.987821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.005854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:30.007038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:30.009107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.009736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.010012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.010281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.017997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.019415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-44cf7469-f5ac-4ded-9cad-87ca8edcf748 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:30.031294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:30.032270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:30.033241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 372/738] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:30.033820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.033820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.034058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.051185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:30.052400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:30.076423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 367/739] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:30.077255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.121197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 373/740] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:30.122036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.137050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.203362 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f0c6-0178-4c58-9ec0-2b0378e9b52e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.232844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd2a6-e0a9-4337-9077-60317362bc31 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.236978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.254136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.255605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.256272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.256846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.270939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.271520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:30.271631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.271838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.272094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:30.278288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:30.279248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:30.280098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:30.283188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 368/741] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:30.284219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.355949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.357874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.368164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.399091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51076b2a-829b-40b9-badf-7c6e624b981c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.433698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.434296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.434574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.434853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.435568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:30.435898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.437331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.454455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 369/742] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:30.455368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.459219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 374/743] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:30.459924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.504214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.559196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36041c3-17df-44bd-a925-eabc71f9edbe None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.559386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d105-b817-45d7-a722-9314dc17ab38 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.568387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.593394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.593988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.594263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.594530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.595185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:30.595479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.595584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.596129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.596408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.596679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.596883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.597318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.598745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.606159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 370/744] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:30.607025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.695540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 375/745] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:30 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:30.696704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.716071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b37bb-1373-4a44-9edd-b24adcd5b71f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.719739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.764524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.765045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.765317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.765580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.766214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.767601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.814598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07f19-cb35-4574-86c8-257579563c36 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:30.840889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 371/746] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:30 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:30.841748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:30.867106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:30.867747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:30.868064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:30.868335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:30.915015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:30.962662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:30.964891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:30.980980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd8eb9-6c5b-45b2-939a-c9fc412ac235 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.029250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.029804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.030077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.030343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.044239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.045700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:31.063305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:31.064305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:31.065246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:31.065246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.065246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:31.065246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 372/747] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:31.065891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.084788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.101224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 376/748] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:31.102810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.172233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.176493 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27263-8cbe-45b1-b5fa-09eb663a7c58 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.212583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.213256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.213470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.213741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.215244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c5762-8fee-4da2-9bcd-44e37647472b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.225525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.226714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:31.242586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:31.243625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:31.244582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:31.244582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.244582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:31.244582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 373/749] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:31.245379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.254656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.255999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.256448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.256921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.257789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:31.258344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.260083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.279908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 377/750] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:31.281070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.318879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.358354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02695-dedc-472e-9baf-146fbd1d7f66 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.388109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bccfbb-a0df-4e36-b95e-03b6e9df617c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.395101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.395814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.396173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.396561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.407814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.409349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:31.424751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:31.425799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:31.426710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:31.426710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:31.426710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:31.426710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 374/751] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:31.427544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.430856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.432635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.433292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.433744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.434611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:31.435144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.436818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.451672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.455436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 378/752] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:31.456772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.555137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a64066-b0b7-44b4-9594-ef0b820d270e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.579413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.581160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c24dc-48bb-49bc-9915-a07cd6f62619 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.603321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.603978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.604261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.604529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.616189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.621246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.629312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.630175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.630666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.631137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.632006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:31.632551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.634151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:31.634376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:31.635219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:31.636208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:31.639940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 375/753] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:31.641819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.653287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 379/754] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:31.654357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.703363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.761536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085cce8-d976-4adb-bb5e-92a565618c67 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.789912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bb9c1-16dc-4a56-969b-c00d4b3b3b1a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.798954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.799846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.800328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.800878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.801754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:31.802259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.803903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.824227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 380/755] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:31.825781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.838332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.839905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.840701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.841182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:31.849925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:31.851617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:31.864423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:31.865377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:31.866397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:31.868991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 376/756] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:31.869975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:31.911726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.956229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f127f-ccf1-4246-b0ec-390839ed5a94 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:31.959882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:31.994802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:31.995994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:31.996317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:31.996576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.002166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a730f-3a2d-4ecc-acfe-6c84387e9ae7 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.005754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.007398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:32.021850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:32.022775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:32.023735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 381/757] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:32.024257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.051747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.052383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.052663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.052930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.053657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=bd93883307a1430bafdd32a91157f811) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:32.053966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.055406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.069520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 377/758] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:31 2022] GET /identity/v3/role_assignments?user.id=bd93883307a1430bafdd32a91157f811&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:32.069520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.222010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b770c-811a-43f9-ae78-f6f0737ccae2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.269765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:32.273934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd09b-c5c2-4044-9725-3a2e1276cfe5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.287518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.303086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.316615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.319829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.319829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.319829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.319829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:32.319829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.320202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.335846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 378/759] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:32.336029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 382/760] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:32.339436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.343624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.390592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:32.495034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9852068-71a8-4cb7-ac88-16d452e3ea88 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.531691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f82-f4cc-4eec-9ea7-1629f4773552 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.564061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.564663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.564938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.565204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.565930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=21315db813dc407d8b0577065110be44) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:32.566231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.567660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.586098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 379/761] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/role_assignments?user.id=21315db813dc407d8b0577065110be44&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:32.590234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.591039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.591318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.591595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.603662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.605527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:32.622569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:32.623607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:32.624553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:32.624553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:32.624553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:32.624553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 383/762] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:32.629596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.687925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:32.774438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec1da-96cc-4137-8212-959c11a94c3b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:32.818519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:32.819130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:32.819411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:32.819678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:32.820351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:32.820652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:32.822077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a480-33f4-4363-8808-cb7dc2fb0d62 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:32.834790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 380/763] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:32.840058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:32.961071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:32.994611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6368b-92d0-4240-bdd7-6bb3c5bcd26e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.008130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0554c-4847-4af6-b4a2-ce7400d5d7f1 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.008414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0554c-4847-4af6-b4a2-ce7400d5d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.008694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0554c-4847-4af6-b4a2-ce7400d5d7f1 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.011639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 381/764] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:33.018850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e87-3216-43e2-a178-794d8df1c8ea None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.019135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e87-3216-43e2-a178-794d8df1c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.019413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e87-3216-43e2-a178-794d8df1c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.036211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:33.037151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.037645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.038116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.045255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-36a00e87-3216-43e2-a178-794d8df1c8ea None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:33.046730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-36a00e87-3216-43e2-a178-794d8df1c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:33.047543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:33.049590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a90b012b-de28-45df-806b-c5b095119a12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:33.065300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:33.066240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:33.067146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:33.069187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 384/765] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:33.074331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce912-5917-4d12-8ea2-9614c764915b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.074331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce912-5917-4d12-8ea2-9614c764915b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.074331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfce912-5917-4d12-8ea2-9614c764915b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.075865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 385/766] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:33.076933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfce912-5917-4d12-8ea2-9614c764915b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.143831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 382/767] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:33.145184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.145481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.145753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.169668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:33.171667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:33.183761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:33.213412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfce912-5917-4d12-8ea2-9614c764915b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.282361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 383/768] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:33.283110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:33.283724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.284025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.284291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.285049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:33.285356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:33.286841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:33.300001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 386/769] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:33.300910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:33.307326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.461698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476e21-467e-4ec1-9929-6d28b708895b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.513038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:33.513705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.513982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.514253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.516225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=1b0807da1ad345eb9de13973cae6bfd8, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:33.517654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:33.600360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 384/770] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:33 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:33.620991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.649410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.653641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:33.779084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9802e-4d9c-4b54-8077-f537767e6934 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.819347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:33.820042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.820323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.820594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.821190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:33.822572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:33.832616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:33.833661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:33.834519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 387/771] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:33 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:33.842611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.846820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918f23-1fa3-44ee-bca3-36572fdd771f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.884737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:33.885953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:33.885953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:33.885953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:33.886628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:33.888251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:33.897666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:33.898726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:33.899601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 385/772] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 24 10:21:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:33.905763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:33.917862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:33.966260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e1e1-ed1a-4311-b1a4-425a3cd56dd2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:33.983607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.003138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.004149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.004630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.005097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.005920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.006435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.008087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.013966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 388/773] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.019275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.020969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f321d1-ee2b-4465-b643-f5203f77f230 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.056565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.057103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.057402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.057662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.059710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.059710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.060997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.065986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 386/774] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:34.071361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.131269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1acd7-9746-4d09-8efd-814e32a891a7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.164267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.170361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.171240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.171734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.172233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.173131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] RBAC: Adding query filter params (type=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.173709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.175514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.181466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 389/775] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.187177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.234313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9d9a3-ba14-4634-8ed1-56010d816ce7 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.292058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.303506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fecb7-73d0-49cc-bfe2-c1dba00b1a29 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.308490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.309126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.316841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.316841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.316841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.316841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.316841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12609e-4914-4b23-86e9-f0786bce44c6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.317592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 387/776] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:34.318945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4932f-d0ef-4900-8325-7bd8f70699a5 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.319228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4932f-d0ef-4900-8325-7bd8f70699a5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.319505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4932f-d0ef-4900-8325-7bd8f70699a5 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.321023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 388/777] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:34.326330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4932f-d0ef-4900-8325-7bd8f70699a5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.350142 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.350798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.351071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.351387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.352188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] RBAC: Adding query filter params (interface=public, service_id=b5214d12574e4c99a7ac0eece5422bb6, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.352493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.354107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50456cfa-b748-4648-9dc3-bc58ebd80dcd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.363262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 390/778] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/endpoints?service_id=b5214d12574e4c99a7ac0eece5422bb6&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.364728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855cd93-6c2a-4341-9648-58290246783a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.365016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855cd93-6c2a-4341-9648-58290246783a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.365287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855cd93-6c2a-4341-9648-58290246783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.385272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7855cd93-6c2a-4341-9648-58290246783a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:34.386517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7855cd93-6c2a-4341-9648-58290246783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:34.440060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.471827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 391/779] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:34.471827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855cd93-6c2a-4341-9648-58290246783a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.472851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4932f-d0ef-4900-8325-7bd8f70699a5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.546116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.546980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.547399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.547830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.548696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] RBAC: Adding query filter params (interface=public, service_id=99b34925653f4733b320a598c7d0a37b, region_id=RegionOne) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:34.549148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.551801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.574899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 389/780] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/endpoints?service_id=99b34925653f4733b320a598c7d0a37b&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.576027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.642022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.685199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e896-676e-471f-b22b-3fab8a4491c2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.689915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855cd93-6c2a-4341-9648-58290246783a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.730688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.731520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.731990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.732406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.733151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.734716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.743478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.744116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.744420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.744660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.746078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:34.748076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c01a0-0485-498e-b302-72d47e5e4f80 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:34.750282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 390/781] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.756274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 392/782] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/services => generated 772 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:34.819544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:34.846031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e10fb-fa30-4c28-86c4-c8858c17c70d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.846506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e10fb-fa30-4c28-86c4-c8858c17c70d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.846785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e10fb-fa30-4c28-86c4-c8858c17c70d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.848442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 393/783] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:34.854397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.855433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.855964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:34.893377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:34.894295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:34.947690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2c2b9-de09-43d7-81f5-3de4c14e3acc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:34.952727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.974506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:34.986512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:34.986969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 394/784] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:34.988326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:34.988326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:34.988326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.000010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:35.004605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:35.005509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:35.006356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 391/785] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:35.012956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.122844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ca40-680d-4048-bfbc-331949b3906f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.163499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.164482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.164966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.165463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.166355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:35.166971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:35.169386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:35.178631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 395/786] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:35.184147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.349368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1672-dc74-4684-bfd7-66598981dc82 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.394008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.400504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.401615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.401615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.401899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.413215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:35.414674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:35.431578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:35.432627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:35.435083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:35.435083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:35.435083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:35.435083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 392/787] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:35.439094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.451101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:35.510935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:35.572909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746969d7-de1b-4794-b970-f182c88813bb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.587889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715bfe-8b2c-487e-8871-c87cbc7d3c7d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.624187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.624794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.625067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.625334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.625968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:35.626263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:35.628005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:35.640747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 393/788] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:35.649456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.650293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.651170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.651697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.652225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.663992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:35.669318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:35.670252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:35.671105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:35.673663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 396/789] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:35.681276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.804101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:35.815957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260d80-fd6e-4eff-932c-60f3f1d35e5d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.860251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:35.866526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1dbdf-b1fd-4552-a4fe-5c3dba061668 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:35.883214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.883865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.884143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.884410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.896851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:35.898282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:35.918440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:35.919528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:35.920498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:35.921030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 394/790] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:35.932808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:35.939747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:35.940668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:35.941170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:35.941639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:35.942494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:35.942994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:35.944589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:35.954697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 397/791] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:35.960296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.115263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ba634-a976-4d90-a12f-5ea63ade83a6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.176052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8658-429a-4f70-aea9-ef1c8599f536 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.201615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.202233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.202517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.202787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.203632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:36.203971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.205400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467d985-d2ea-4708-971c-e23a93d55154 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.215310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.216229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.216724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.217201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.225706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 395/792] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:36.231573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a27373-3abf-44c4-8975-1231212c622e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.231573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a27373-3abf-44c4-8975-1231212c622e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.231573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a27373-3abf-44c4-8975-1231212c622e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.234314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 396/793] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:36.234580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.235452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.235735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.236400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.237301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:36.252955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:36.253905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:36.254797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:36.254797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:36.254797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:36.255763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:36.257030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:36.257254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 398/794] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:36.258273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.268572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:36.272165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:36.335906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 397/795] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:36.337067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.372232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b26948-69d4-48df-9278-7731323f02d1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.402221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.403824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.403824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.403824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.419810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.419810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:36.434815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:36.436113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:36.437030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:36.437030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:36.437030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:36.437030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 399/796] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:36.440432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.509392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:36.525521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6b48c-eb68-4fe5-af63-696ba22e555e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.547809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0850-f42f-4888-8ed9-2ddcea14c966 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.596996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.597605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.597881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.598150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.598797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:36.599356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.600743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.607942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.608556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.608833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.609103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.609740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:36.610047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.611404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.627974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 400/797] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:36.636622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.639347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 398/798] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:36.646358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.655416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:36.819570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464eb1-2cb8-4004-bafe-b91e9c8b44f1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.845365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff01a-324d-42a2-8b4b-a5aafeec4904 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:36.851152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:36.862875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.863510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.863864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.864146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.872111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.873788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:36.885524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:36.887044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:36.888003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:36.889335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 401/799] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:36.894265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:36.900543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:36.901616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:36.902105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:36.902626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:36.911579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:36.913488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:36.926223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:36.927181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:36.928576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:36.931332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 399/800] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:36.932449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.003348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.025044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa37f-bdb9-4e34-a124-9fe953e7558f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.045490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94daa6-a23a-4c3c-8f59-d0304068dc71 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.059931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.060558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.060836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.061108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.070991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:37.076703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:37.077816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 402/801] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:37.078697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.084485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.085098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.085378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.085768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.086466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:37.086771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.088236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5b3b-ff10-48d2-8125-2c37112b4158 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.102925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 400/802] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:37.103988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c917-09a7-44e7-9130-1820fda8125b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.104270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c917-09a7-44e7-9130-1820fda8125b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.104574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c917-09a7-44e7-9130-1820fda8125b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.106182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 401/803] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:37.107197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4976b5-fc55-43b0-b3f5-a24e6391feec None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.107493 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4976b5-fc55-43b0-b3f5-a24e6391feec None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.107950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4976b5-fc55-43b0-b3f5-a24e6391feec None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.109106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 402/804] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:37.109744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4976b5-fc55-43b0-b3f5-a24e6391feec None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.130906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.188755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc0ed8-8832-4a07-813a-0f0d9e9ba8a6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.210951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4976b5-fc55-43b0-b3f5-a24e6391feec None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.221954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.222557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.222828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.223086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.223819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:37.224374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.225783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.235308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.243921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 403/805] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:37.245272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.247069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.247175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.247175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.247175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.247175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:37.247428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.248783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a70e2-0822-4cd5-8359-8e597de80a82 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.257095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 403/806] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:37.258306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad10a-89b6-4d1d-9b3f-e2d029143103 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.258590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad10a-89b6-4d1d-9b3f-e2d029143103 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.258859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad10a-89b6-4d1d-9b3f-e2d029143103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.277675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-71aad10a-89b6-4d1d-9b3f-e2d029143103 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:37.278838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-71aad10a-89b6-4d1d-9b3f-e2d029143103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:37.343981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.346711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a286f-00b2-47f4-b8f6-5e903b85ef8f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.349834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 404/807] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:37.351129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.351460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.351798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.375039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:37.376279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:37.381282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.382453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.382739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.383014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/bd93883307a1430bafdd32a91157f811/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.399609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=bd93883307a1430bafdd32a91157f811, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.401084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.444675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 405/808] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:37.445692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.470985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 404/809] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:37 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/bd93883307a1430bafdd32a91157f811/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:37.475984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.502826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.563209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918b86a-d5d5-4b06-974a-83cce46d4f95 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.601989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.602993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.603632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.604144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.617256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.619110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.627455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e11e-d144-42fc-b9e8-b479610e7352 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:37.639259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:37.640355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:37.641264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:37.641264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:37.641264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:37.641264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 406/810] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:37.642138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.679520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.680205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.680487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.680758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.696887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.698152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:37.717577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:37.718632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:37.719534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:37.719534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:37.719534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:37.719534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 405/811] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:37.719534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.722399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.771495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.779022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b23f-6eac-4bc5-95fe-ab24ffe1ee9c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.824617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.825244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.825512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.825779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.826354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.827713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.833989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e71b-42eb-4d7f-8f96-e43a06bd37c5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:37.836943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:37.839885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:37.840926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 407/812] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:37.841833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.877657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:37.878443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:37.878817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:37.879181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:37.879976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:37.880376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:37.881827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:37.899470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 406/813] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:37.899470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:37.960684 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:37.972811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840625e0-d476-41e0-8b11-4d1871a7745e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.003303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e3f1-4223-44ff-8b2a-df8ac1b4f72f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.007930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.008715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.009092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.009463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.010205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.010604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.012921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.025047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 408/814] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.026000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.042848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.043628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.043996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.044331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] PATH_INFO: `/v3/services/network` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.045038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.046456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:38.057448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:38.058733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:21:38.059738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:38.060599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.060673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 407/815] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:37 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:38.060895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.152031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07208-ada4-459b-8440-a9f12fe4ad90 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.170987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1447-07ef-4e5c-b816-5843d7834b44 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.189951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.190553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.190829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.191096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.191848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.192148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.193505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.197072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.198197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 409/816] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.199218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.210582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.211267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.211486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.211753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.218875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.220591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:38.233894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:38.234991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:38.236150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:38.238459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 408/817] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:38.239343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.304089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.323072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f622f3-bb07-4d08-85c1-9edc4a93dcde None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.349813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5b98-87f6-410b-87fc-a311882405c9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.362965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.363595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.363897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.364170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.372040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.373705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.384227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.384888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.385170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.385439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:38.386477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:38.387466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:21:38.393640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:38.394303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.394303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.394459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:38.394540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.394621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.403702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 409/819] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.403702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.456430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.500961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203cb1-d6f2-4c44-85ae-56845df31941 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.510018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270537b6-c0f9-43d1-8f3f-67cb31cc27b0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.540238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.540837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.541116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.541385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.542035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.542338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.543848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.546880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.547483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.547754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.548044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.548715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.549011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.553851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 411/820] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.553851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.554071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.567071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.567951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.572823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.666523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b5a06-9332-4af1-99e3-5f56506378fd None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.676400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821b28-a6ba-4c6c-9765-9e75a78dd97c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.689289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.704090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.704704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.704985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.705248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.708667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.708667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.708667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.715091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.715750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.716062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.716514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.717049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] RBAC: Adding query filter params (type=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:38.717340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.718696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.723823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 411/822] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.724996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.731158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 412/823] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:38.732175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:38.808956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:38.833556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10775-20ae-4459-ba9b-705a4246e8cb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.843878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14ba-2975-48bf-9b46-090746b2db80 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:38.869734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.870918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.871323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.871589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.872264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.873606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.879559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:38.880236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:38.880514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:38.880785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/21315db813dc407d8b0577065110be44/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:38.882659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=21315db813dc407d8b0577065110be44, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:38.884105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:38.975860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 412/824] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:21:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:38.976667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:39.016963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 413/825] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:38 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/21315db813dc407d8b0577065110be44/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:39.018590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:39.039816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:39.185977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e5ac5-e846-41cf-9cac-1d656cff1950 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:39.254443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:39.255083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:39.255769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:39.255769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:39.256305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:39.257669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:39.278803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280eb7c-fcc2-4ca8-b67e-51f9e4958621 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:39.315521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:39.323987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:39.324839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:39.325313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:39.325762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:39.363914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 413/826] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:21:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:39.424589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:39.426415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3514bd-4332-4a8d-88ae-55a88aa473d1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:39.553451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 414/827] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:39.559566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:39.737546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ffe7-def1-4bc0-93b0-b9c708bcd01b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:39.738069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ffe7-def1-4bc0-93b0-b9c708bcd01b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:39.738069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ffe7-def1-4bc0-93b0-b9c708bcd01b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:39.739620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 415/828] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:39.743528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:39.744911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:39.745806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:39.746080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:39.767748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:39.768973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:39.773097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5d99-0e94-483c-a075-f75c8ac2ec9a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:39.797416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:39.822401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:39.822950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:39.823877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:39.824163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:39.834973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:39.836479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:39.847724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 416/829] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:39.858479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:39.859442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:39.860383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:39.860383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:39.860383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:39.860383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 414/830] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:39.865351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:39.977540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2612b6-063b-435b-993d-e063fa377d0d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.013303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.014209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.014707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.015169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.016045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:40.016556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.018100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.029797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 417/831] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:40.035405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.142803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2be7f-aeb1-43e1-9fad-0e29ec8f3ed9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.169077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.174132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.180900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.182392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.189869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.189869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.192794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.194184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.194391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:40.210375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:40.211324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:40.212260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:40.216030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 415/832] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:40.217887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.300040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758108cb-77d2-4a3c-b6cc-ac68dc4c9396 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.348289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8691d-95b3-4a83-8f0b-05c1e1b98927 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.356538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.357824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.358116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.358392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.373334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:40.380076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:40.381037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:21:40.381906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:40.383954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 418/833] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:40.388777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.394954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.395527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.395845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.396112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.396899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:40.397206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.398719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.418124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 416/834] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:40.424075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.479122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.501539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.523082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26742a-c930-405a-9d74-d09890bf75ec None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.549799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b554b-05a0-4a38-a01f-d7e32a96d58d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.560005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.560600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.560871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.561477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.561794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:40.562085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.563442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.576102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 419/835] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:40.577521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.596456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.597090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.597365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.597635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.598345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:40.598697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.600429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.613128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 417/836] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:40.705647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a12cf-29c6-4c7e-a455-695bab6eeabf None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.743613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.744955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.745950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.746381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.756703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.759856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.762117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:40.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:40.781065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:40.781959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:40.781959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:40.781959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:40.781959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 420/837] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:40.788279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:40.907385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f706dc-667d-416a-9c7d-605aef16bfbf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:40.922840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:40.944824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:40.945433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:40.945713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:40.945986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:40.946633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:40.946935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:40.949036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:40.962967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 418/838] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:40.968438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.077922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee97113-a500-4773-b4e0-36150e57ef53 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.114793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:41.115758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.116263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.116728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.125156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:41.126906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-7075271d-f3d7-440e-8f12-c4ff4f74bb49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:41.139368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:41.140375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:41.141308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:41.147807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 421/839] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:41.149716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.262030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58beb90-03d6-45ff-b9f1-884a38a6d1be None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.280545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c306-7faf-4f41-aa4b-857bb140caae None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.280858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c306-7faf-4f41-aa4b-857bb140caae None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.281102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c306-7faf-4f41-aa4b-857bb140caae None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.286360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 422/840] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:41.287989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613ae9-57a8-42bc-b3d7-96f5320c7671 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.288278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613ae9-57a8-42bc-b3d7-96f5320c7671 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.288556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613ae9-57a8-42bc-b3d7-96f5320c7671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.300748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:41.301357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.301633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.301898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.302624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:41.302924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:41.304373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56614e07-4dd8-46bb-8c99-e9b87e808972 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:41.310460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0e613ae9-57a8-42bc-b3d7-96f5320c7671 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:41.311843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0e613ae9-57a8-42bc-b3d7-96f5320c7671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:41.324740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 419/841] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:41.325998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93d550-ef85-430c-ae12-d6e430496993 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.326276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93d550-ef85-430c-ae12-d6e430496993 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.326604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93d550-ef85-430c-ae12-d6e430496993 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.330664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 420/842] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:41.331418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93d550-ef85-430c-ae12-d6e430496993 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.362942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:41.369347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:41.395834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 423/843] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:41.395834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.395834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.395834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.420904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:41.422082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:41.454365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93d550-ef85-430c-ae12-d6e430496993 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.496812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:41.497538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.497860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.498226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.499819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 424/844] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:41.569568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:41.570954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:41.602634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:41.672620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.675011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 421/845] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:41.681332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.795772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636fd46-32e7-4cc3-a6cc-3ef1761b9408 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.801037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87633-88c6-4ba0-aa57-415afb62d916 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.810616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:41.832505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:41.833311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:41.833942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.834218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.834485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.835216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:41.836617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:41.837539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:41.838313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:41.838504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:41.838776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:41.849467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:41.856099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:41.857159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 425/846] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:41.858160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.858745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:41.860383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:41.878498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:41.879529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:41.880466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:41.880466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:41.880466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:41.880466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 422/847] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:41.881362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:41.969607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7881cb-bb56-479e-9a44-160e8b741bce None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:41.993925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05f66-7aee-4865-835f-595de65e7ca0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.006132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.006752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.007024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.007290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.018492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:42.023605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:42.024576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:42.025490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 426/848] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:42.027268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.035365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.036006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.036286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.036556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.037181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.037756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.038828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.044346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 423/849] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.044937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.070518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.097447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.141298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca462a-b4c4-4d7b-b6c7-bafc8709e472 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.154045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728488-ab8d-4d24-9b52-e0add7e165b3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.176882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.177483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.177759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.178027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.178661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.178961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.180359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.196558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 427/850] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.197371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.200306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.200922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.201281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.201609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.202285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.202711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.204110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.213106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 424/851] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.214364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.302501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.308903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a953a6-6083-4a90-a775-26dafcf6d0c9 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.330455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5e8f-2e73-4509-adff-439d0c882cc7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.343671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.345126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.345729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.346006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.346276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.346907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.347205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.350696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.353832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 428/852] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.354830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.388679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.389679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.390130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.390538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.398583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.400456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:42.413563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:42.414708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:42.415763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:42.422589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 425/853] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:42.423883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.495942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce4d9-82dd-4cfa-85f8-6cb2fb65531b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.539367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.540536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.540958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.541641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.553897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2a8d-14d3-48c5-adce-a802741a09aa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.555516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.558869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:42.578754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:42.579889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:42.580812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:42.580812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:42.580812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:42.583518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 429/854] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:42.591826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.604006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.605754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.606234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.606569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.607848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.608301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.612368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.627877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 426/855] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.628177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.634704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.672849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.712099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225164ef-877f-43fa-83e7-9b55a52d8dd1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.747176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd21d-47ad-4a34-9cc9-497a8a5ae91d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.750647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.751253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.751526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.751813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.752445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.752740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.754094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07671532-3414-41e4-a40b-0217ac2d3915 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.767491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 430/856] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:42.768562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6f38-552f-4dc3-8af4-d242e13bab74 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.768843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6f38-552f-4dc3-8af4-d242e13bab74 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.769112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6f38-552f-4dc3-8af4-d242e13bab74 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.774790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 431/857] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:42.774790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6f38-552f-4dc3-8af4-d242e13bab74 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:42.790966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.791817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.792163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.792504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.793294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=bd93883307a1430bafdd32a91157f811) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:42.793665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.795394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc15fcf-2e34-47ab-8d9d-66e3a349d9e1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.801825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 427/858] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/role_assignments?user.id=bd93883307a1430bafdd32a91157f811&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:42.802825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.803105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.803370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.822997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:42.825164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:42.868802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:42.906228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc6f38-552f-4dc3-8af4-d242e13bab74 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:42.909512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 428/859] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:42.946285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:42.947169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:42.947598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:42.948045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:42.957338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:42.958994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:42.971183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:42.972340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:21:42.973523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:42.975574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 432/860] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:42.982136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.008721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.089951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b95f3-0ee7-44cf-9aa6-6d24d4e570c4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.126739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.127665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.128187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.128680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.129601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:43.130108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.131798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.149998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 429/861] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 24 10:21:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:43.155961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.184175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.261541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b164e-879d-4f6f-9150-4d53a500d3b1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.294247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.296214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.300435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.301238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.301652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.302065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.316101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9abd-7cef-4875-99db-994035ddd3fe None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.355319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.356009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.357055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.357055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.357239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.358651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:43.368350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:43.369510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:43.371652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:43.375249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 430/862] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:43.376649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.390448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.391918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.490104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25a3ec-08a1-4b53-bd7f-51af60a6072a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.499894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 433/863] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:43.502123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.530184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.530891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.531170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.531537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.532199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:43.532501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.534147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.534552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.541519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 431/864] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:43.549459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.561005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.608040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d06455-c4db-43a9-b2d0-0e1747fe3d9c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.644229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.644781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.645099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.645365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.656322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.657765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.662092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299bd3-52ec-4883-8cf0-32c871bf9c96 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:43.673565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:43.674823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:43.676106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:43.676106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:43.676106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:43.679388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 434/865] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:43.680375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.704629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.705533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.705953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.706360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.707119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:43.707677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.709301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.721053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 432/866] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:43.777253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.794949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115b76-b642-4fd7-823c-8a66a7b0a819 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:43.834039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:43.834656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:43.834929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:43.835193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:43.835874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:43.836174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:43.837634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:43.851611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 435/867] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:43.857994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:43.941200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.967984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120599b7-5daf-4204-81cd-cfe2515b84ad None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:44.005516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:44.006483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:44.006961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:44.007403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:44.015156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:44.016862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:44.029187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:44.030122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:44.031021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:44.033137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 433/868] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:44.039824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:44.150207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a706-3bf3-4c75-97d8-860fc33767ea None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:44.188288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:44.189049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:44.189328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:44.189645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:44.190481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:44.190789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:44.192366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0170-b414-476a-8abc-ba43e20b52cd None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:44.207821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 436/869] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:44.213786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:44.342758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218398b6-f76d-4557-9155-0f889c57a3d9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:44.381201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:44.382193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:44.382676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:44.383139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:44.384364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=21315db813dc407d8b0577065110be44) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:44.384891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:44.386627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34fc1-fd49-4567-b763-0f1583daf33f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:44.388859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:44.395004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 434/870] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:44 2022] GET /identity/v3/role_assignments?user.id=21315db813dc407d8b0577065110be44&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:44.442653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1173-da3c-48fb-a051-b37de74ecc3f None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:44.443252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1173-da3c-48fb-a051-b37de74ecc3f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:44.443742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1173-da3c-48fb-a051-b37de74ecc3f None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:44.445803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 437/871] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:21:44.452781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb5a-4ac3-414d-b46e-038dfd741f68 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:44.453409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb5a-4ac3-414d-b46e-038dfd741f68 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:44.453882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbb5a-4ac3-414d-b46e-038dfd741f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:44.475730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2edbbb5a-4ac3-414d-b46e-038dfd741f68 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:44.478719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2edbbb5a-4ac3-414d-b46e-038dfd741f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:44.580475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 435/872] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:44.900749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c1173-da3c-48fb-a051-b37de74ecc3f None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:44.906154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:45.018660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9325-74bb-4a41-92b7-9a8c066c780d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.021278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c1173-da3c-48fb-a051-b37de74ecc3f None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:45.021488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9325-74bb-4a41-92b7-9a8c066c780d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.021959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9325-74bb-4a41-92b7-9a8c066c780d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.028837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 436/873] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:45.031563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.032233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.032721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.056720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:45.059262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:45.062259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:45.063949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.068177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.068638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.069899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:45.071961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:45.147831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 438/874] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:44 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:45.153393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 437/875] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:45.453292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:45.540297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:45.581273 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a881e5-fcc9-4311-b675-572b8a2551ed None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:45.618927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:45.619562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.619867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.620856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.631803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:45.637515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:45.638447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:45.639577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 439/876] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:21:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:45.651403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:45.726038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:45.772471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0a32-bf87-4e0c-9a0d-5e443bb44c93 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:45.807696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:45.808455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.808764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.809036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.809706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:45.810010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:45.811379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc6c51-fabd-4e95-845a-75ec18aef348 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:45.820271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 438/877] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:21:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:45.826538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:45.850214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669dd14-d2ee-481c-aedb-ab5a5cbbb03a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.850515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669dd14-d2ee-481c-aedb-ab5a5cbbb03a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.851228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669dd14-d2ee-481c-aedb-ab5a5cbbb03a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.853138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 439/878] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:21:45.858407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.858689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.858958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.877324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:45.878505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:45.940962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4d7c-1153-4481-8b48-e1f4f636b790 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:45.951879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 440/879] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:45.968090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:45.980477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:45.981341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:45.981766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:45.982240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:45.993522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:45.995764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:46.012247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:46.013410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:46.014552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:46.014552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:46.014552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:46.016416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 440/880] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:46.022412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.072217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:46.127592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67321cd-aa73-48d4-8aa7-7468eafdc853 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:46.163817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:46.164696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.165121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.165541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.166333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:46.166802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:46.169111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.181541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 441/881] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:46.188509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.249249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.315168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05b14b-e336-481b-8d92-1373300c89d8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:46.365956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:46.366966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.367468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.367977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.372161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319d18c-c1c4-47c3-8ad3-3c1c02a4ec32 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:46.376651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:46.378312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.380045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:46.391469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:46.392649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:46.393645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:46.396061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 441/882] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:46.402684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.422501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:46.423166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.423447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.423716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.424813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:46.426238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c62a52-0fc4-4b47-8e04-3d5edd64e281 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.442885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:46.511477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6cd0-35e8-4b46-a972-61b3cb0b811f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:46.515949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 442/883] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:46 2022] POST /identity/v3/services => generated 269 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:21:46.566726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:46.567355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.567634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.567929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.568679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:46.568986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:46.570527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.573657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c65fc-1c77-469f-ac11-be0d07c30f95 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.574217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c65fc-1c77-469f-ac11-be0d07c30f95 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.574791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c65fc-1c77-469f-ac11-be0d07c30f95 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.576705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 443/884] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:46.582041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.582341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.582581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.596364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 442/885] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:46.602221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.605367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:46.606709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:46.687028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 444/886] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:46.716794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:46.726277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab542-4a8e-4a63-9694-730a9998360d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:46.762609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:46.763141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:46.763557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:46.763858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:46.839777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:46.841682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:46.944172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:46.952146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 443/887] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:21:46.955427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:46.959063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.064881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.065387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5432-107f-4103-bb07-5cdec87e69f6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.076694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a559b2-aaa5-43f2-ada6-b02548134e1b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.103998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.105247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.105526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.105797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.106384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.107966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:47.117257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:47.118512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:47.119670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.123976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 444/888] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:47.124856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.130140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.130961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.131389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.131827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.146367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.148619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:47.169572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:47.170762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:47.171882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:47.171882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:47.171882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:47.178820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 445/889] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:47.180321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.192787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.242660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b517a-a52b-475b-87f7-822d939b0cd5 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.280932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.281963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.282541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.282989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.283810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:47.284297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.285954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9bcb-a379-4f21-910a-ac7a139474ba None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.291053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 445/890] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:47.293409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d4d-7f43-46b3-b566-6fe744865ac1 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.293684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d4d-7f43-46b3-b566-6fe744865ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.293955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d4d-7f43-46b3-b566-6fe744865ac1 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.295365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 446/891] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:47.300445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc6d4d-7f43-46b3-b566-6fe744865ac1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.304223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeafadb-4724-4a23-859b-9617dcfcf451 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.343542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.344101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.344381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.344651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.345289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:47.345592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.346944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ecc6e-4afa-4d8c-b979-c12d32cba759 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.360978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 446/892] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:47.362259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.362549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.362823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.381391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:47.382577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:47.384720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.411972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc6d4d-7f43-46b3-b566-6fe744865ac1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.429704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.447888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.449165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.449435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.449928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.450371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:47.450672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.452158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.467819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 447/893] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:47.467819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.468107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 447/894] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:47.581956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379ba92-c0c3-44cf-8907-b9d31c388686 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.627605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.627605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.627954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.628194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.635492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.637682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:47.649667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:47.650583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.651608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 448/895] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:47.656861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.732303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.775122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc157a-3565-40cf-9a11-b62bf73dfbea None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.792922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.813489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.814431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.814991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.815272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.816170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:47.816480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.818474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.833066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 448/896] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:47.833587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.839121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.863958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4c28e-a774-4f4c-b689-a8e38ecc6d22 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.900022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.900571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.900851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.901158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.901759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.903249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:47.914450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:47.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:47.917522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:47.919731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 449/897] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:47.921018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:47.950643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195eead-3840-408e-a3f7-c22227bd34da None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:47.989566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:47.990445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:47.990853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:47.991283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:47.992286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] RBAC: Adding query filter params (role.id=82f3c2795f2640b6807d03aba20096a7, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=bd93883307a1430bafdd32a91157f811) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:47.992737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:47.994466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:48.001081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 449/898] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/role_assignments?user.id=bd93883307a1430bafdd32a91157f811&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=82f3c2795f2640b6807d03aba20096a7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:48.033128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112b44-9c86-43af-82f0-708b2d6a6bd1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:48.042771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:48.074947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:48.075635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.075952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.076229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.076873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:48.077178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:48.078690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:48.089508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 450/899] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:48.091115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:48.162798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:48.204990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404514-8033-4013-a342-f82d8d46ff99 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:48.240320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:48.240924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.241203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.241474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.242101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:48.242399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:48.243835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:48.254341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 450/900] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:48.255735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:48.365312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03c47-cab1-421f-81f3-7cee04984e46 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:48.403047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:48.403715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.404030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.404303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.405046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] RBAC: Adding query filter params (interface=public, service_id=6f2cf5a7e742415fb5de34cf59310c84, region_id=RegionOne) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:48.405356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:48.406781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c941-ec95-4a49-8391-0eba3ffe020c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:48.417045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 451/901] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:21:48 2022] GET /identity/v3/endpoints?service_id=6f2cf5a7e742415fb5de34cf59310c84&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:48.418300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:48.524001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095c161-f388-4fae-b7ad-af5377ce17b3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:48.556419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:48.563809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e045c34-01df-4c62-aa53-03574644e308 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:48.576996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 451/902] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:21:48 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:21:48.614353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2699a-7393-4b38-aac8-8807dcbb04e6 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.614691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2699a-7393-4b38-aac8-8807dcbb04e6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.614948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2699a-7393-4b38-aac8-8807dcbb04e6 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.616632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 452/903] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:48.623112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:48.623420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:48.623667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:48.644314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:48.645594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:48.726643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 452/904] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:48.998990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2699a-7393-4b38-aac8-8807dcbb04e6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:49.037489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:49.108828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2699a-7393-4b38-aac8-8807dcbb04e6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:49.148602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:49.149237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.149517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.149788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.150373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:49.152347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:49.161543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:49.162488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:49.163408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 453/905] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 24 10:21:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:49.169183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:49.276183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fde3b-2793-4a3e-b27f-aa69b3df27b1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:49.298054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:49.312782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:49.313364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.313640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.313906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.314533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:49.314830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:49.316215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:49.321362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 453/906] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:49.328176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:49.428812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:49.433144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b3bb-2729-4fdc-8bf2-8457e27d6644 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:49.469068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:49.469674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.469949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.470214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.470898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:49.471198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:49.472585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15cb3f-86e4-425c-bdad-927a334e0572 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:49.478239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 454/907] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:49.484682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:49.589333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9f0c1-8edc-4309-b982-b193bf58b9c3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:49.603309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b22d-9b0f-4726-a01b-1b651458db8e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.603612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b22d-9b0f-4726-a01b-1b651458db8e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.603891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b22d-9b0f-4726-a01b-1b651458db8e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.606351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 455/908] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:49.611948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.612245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.612517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.627901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:49.628509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.628784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.629049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.629747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] RBAC: Adding query filter params (interface=public, service_id=8551be5664ba43f18b2b52c4cb062aa0, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:49.630051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:49.631458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:49.634424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:49.636180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:49.637514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 454/909] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:21:49 2022] GET /identity/v3/endpoints?service_id=8551be5664ba43f18b2b52c4cb062aa0&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:49.643137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:49.699826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:49.739885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 456/910] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:49.761959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09835-eda6-4351-b002-c4ff13091e01 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:49.797259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:49.797859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:49.798218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:49.798494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:49.799085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:49.800504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960a38-cf3e-43f7-9d13-a1e48d7489ae None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:49.806544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 455/911] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:21:49 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:21:50.023023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:50.088171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72383b4-30d4-4b59-b779-52560f8f8c0a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.088654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72383b4-30d4-4b59-b779-52560f8f8c0a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.088968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72383b4-30d4-4b59-b779-52560f8f8c0a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.090569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 456/912] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:50.095544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.095867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.096145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.115279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:50.116494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:50.126883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:50.137807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d58dd-c94e-4af2-a627-91d708f0e484 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:50.174671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:50.175236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.175586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.175946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.176655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:50.178156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a6644-e059-42a4-885a-fab0e66d2d9d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:50.206080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 457/913] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:50.254750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 457/914] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:50 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:50.498614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:50.545803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:50.605546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e6951-d919-4ae8-8b18-6fd4204ade7f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:50.610922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d5e6-4187-4220-9171-74e28a5a937e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.611380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d5e6-4187-4220-9171-74e28a5a937e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.613297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d5e6-4187-4220-9171-74e28a5a937e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.613297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 458/915] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:50.618234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.618517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.618789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.638554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:50.639814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:50.653806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:50.654681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.655464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.655748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.669876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:50.675216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:50.676360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:50.677336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:50.679495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 458/916] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:21:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:50.686003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:50.727897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 459/917] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:50.797343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98efa07-e94f-464f-be0e-ce0f7d4cbbf5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:50.799994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:50.833226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:50.833838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.834116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.834388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:50.835050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:50.835351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:50.836794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:50.846849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 459/918] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:21:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:50.852635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:50.939687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:50.958632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c237e01-d5ca-40bf-970f-debcb555a9c9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:50.994681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:50.995609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:50.995943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:50.996213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.001993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.007840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.009346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:51.029527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:51.030500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:51.031413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:51.031413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:51.031413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:51.036571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 460/919] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:51.037234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.118444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c221-4ac9-42b3-b24d-c813d9cb1a9d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.154818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.155429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.155713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.156216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.156632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.158088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.166237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c181cd-9cf0-433b-a48e-f487cf2a9ccb None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:51.167813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:51.168986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:21:51.169980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:51.176180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 460/920] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:51.177196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.214365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.215278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.215725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.216178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.216986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:51.217453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.219007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.221185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.228225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.235460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 461/921] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:51.240358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.297741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7440d-80bf-49b2-af5f-ed928f74d00d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.353125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.354322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.355772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.356545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.357378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:51.358099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.360051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.367043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 461/922] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:51.373258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.379083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275795-3b86-45d8-9634-32f55bcdd985 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.425760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.426390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.426666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.426933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.437310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.439022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:51.454528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:51.455536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:51.456512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:51.463414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 462/923] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:51.464638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.482214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.498222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a76f-2a84-4429-bed5-83645439b23c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.525017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.536744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.537373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.537650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.537946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.538778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:51.538887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.540247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.550409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 462/924] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:51.551764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.584219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435477-e898-4064-99ef-85cf456c2abf None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.627708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.628515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.628713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.628981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.629708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:51.630125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.632128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.660470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 463/925] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:51.662624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.687281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1568fb-f428-4aaf-908d-a5493090a993 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.722829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.723351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.723686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.724247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.724952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.726322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4e704-6d70-4189-8b33-74865b098ed2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.777794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d9fa6-beb6-46a0-b52d-3ca78364d2ec None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:51.791062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.800758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 463/926] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:21:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:51.802392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d60b5-2343-4409-87d6-8cfc055364a3 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.802871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d60b5-2343-4409-87d6-8cfc055364a3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.803286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d60b5-2343-4409-87d6-8cfc055364a3 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.805180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 464/927] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:51.817935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.818525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.819003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.829678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:51.834065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:51.834065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:51.834065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:51.841379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:51.843249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:51.843537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:51.845244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:51.846041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:51.862982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:51.864291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:51.865401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:51.865401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:51.865401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:51.866924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 464/928] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:51.873308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:51.955828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 465/929] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:52.011702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3eb3-8d01-43b6-b7e4-602712846b69 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.047581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.048217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.048497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.048769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.049415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:52.049714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.051078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.064587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 465/930] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:52.069796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.180314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13888bf5-126e-4cf6-8bee-aeddb0473f81 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.217306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.218319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.218809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.219278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.226995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.228725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.231228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-fb5e262b-9c32-4d6a-9210-13337c3889b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:52.241567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:52.242445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:52.243335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:52.246119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 466/931] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:52.253089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.259302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cad4-9cbe-4380-8e71-3c810f7ad0bc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.259583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cad4-9cbe-4380-8e71-3c810f7ad0bc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.259896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cad4-9cbe-4380-8e71-3c810f7ad0bc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.261494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 467/932] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:21:52.262108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cad4-9cbe-4380-8e71-3c810f7ad0bc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.277629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.371245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427465-7f1b-42f8-aa8e-aebc3a7b3f9b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.394585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cad4-9cbe-4380-8e71-3c810f7ad0bc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.408286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.409015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.409293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.409559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.410250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:52.410550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.411993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d424e-6d85-4b9b-8f1d-0c4e91a0bf20 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.428993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 466/933] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:52.428993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.428993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.428993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.442476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.443108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.443411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.443645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.444258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.444358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:52.445450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:52.445625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:52.457921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:52.458860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:21:52.459806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:52.460562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 468/934] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:52.461222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.523738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 467/935] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:52.524568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.528297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.541871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.572118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b4a0-ecc5-4ad7-a3bc-ea18092bc2b0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.609825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.610932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.611405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.611891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/bd93883307a1430bafdd32a91157f811/roles/82f3c2795f2640b6807d03aba20096a7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.614415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=bd93883307a1430bafdd32a91157f811, role_id=82f3c2795f2640b6807d03aba20096a7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.616071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.637968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af77ef-f8a0-42c3-87d1-9335d067bc64 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.673443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.674048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.674335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.674591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.675207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:52.675505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.676894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.683986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 468/936] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:52.687331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.732021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 469/937] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:21:52 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/bd93883307a1430bafdd32a91157f811/roles/82f3c2795f2640b6807d03aba20096a7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:21:52.781561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.797417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.816511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ffb08-1e51-418b-91c2-2d7a4733a226 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.854914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:52.855529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:52.855846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:52.856126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:52.856815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:52.857064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:52.858865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:52.864271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 469/938] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:52.870574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:52.960912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119238-2080-4249-8145-4ae5de3f2d58 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:52.989282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.002904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.004127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca29f-177f-473b-8f32-b45070badb3f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:53.004265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.004686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.005245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.006081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.007767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:53.018345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:53.019489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:53.020422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:53.023391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 470/939] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:53.029222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:53.041568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.042914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.043382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.043663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.045319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.046854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.056527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.145384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd83a3d-4b22-4da0-8288-d97de593ef7d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:53.177083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 470/940] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:21:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:21:53.207311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.208021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.208306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.208576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.209324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:53.209630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.211065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.217723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 471/941] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:53.224463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:53.351086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a86499-74b7-4222-b5a3-53643e14cd2c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:53.387995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.388734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.389012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.389281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.389910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:53.390208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.391576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.399908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 471/942] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:53.403163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:53.456172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.517329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515a67-382b-4354-bdc3-71b87ce84d80 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:53.553458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.553980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.554259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.554531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.555229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] RBAC: Adding query filter params (interface=public, service_id=8f00167890b5426898ee31ec1439727e, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:53.555535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.556917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d080b-e4e9-41f1-b9f7-0bc455f2cb31 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.567813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 472/943] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:21:53 2022] GET /identity/v3/endpoints?service_id=8f00167890b5426898ee31ec1439727e&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:53.569246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:53.631252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.676457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f93b-c076-4dde-bc4d-ebbd969633ee None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:53.712548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:53.713159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.713439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.713854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.714642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:53.716184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1a115-720e-4ad1-8c1c-6fe63c1f6eba None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:53.724449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 472/944] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:21:53 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:21:53.861577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3263a-d1ae-49bb-9d8c-0f7a8bc4ea85 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.861772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3263a-d1ae-49bb-9d8c-0f7a8bc4ea85 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.862045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3263a-d1ae-49bb-9d8c-0f7a8bc4ea85 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.863502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 473/945] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:53.868877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:53.869391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:53.869946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:53.889310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:53.890828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:53.962793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 473/946] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:54.237943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3263a-d1ae-49bb-9d8c-0f7a8bc4ea85 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:54.345367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3263a-d1ae-49bb-9d8c-0f7a8bc4ea85 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:54.356764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:54.381612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:54.382303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:54.382581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:54.382847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:54.383514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:54.385014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:54.388658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING keystone.server.flask.common [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:21:54.437669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.sql.core [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:21:54.437669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:21:54.437669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [parameters: {'id': 'b13cce9d08c74bec89e9e44f11ee06c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:21:54.437669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81656) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b13cce9d08c74bec89e9e44f11ee06c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b13cce9d08c74bec89e9e44f11ee06c1. Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:54.455615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 10:21:54.456507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application yield resource Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise self.value Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application session.commit() Aug 24 10:21:54.457449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:21:54.458344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:21:54.459241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:54.460075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [parameters: {'id': 'b13cce9d08c74bec89e9e44f11ee06c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:54.460954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:54.461759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b13cce9d08c74bec89e9e44f11ee06c1. Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:54.464890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 474/947] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Aug 24 10:21:54 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:54.466192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:54.541393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:54.570998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b3b1-65b8-47fd-8ff1-3693664c49bb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:54.609637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:54.610268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:54.610545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:54.610816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:54.617902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:54.619346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4781b3e8-5d93-487f-88a4-b8b571563ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:54.630872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:54.633006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:54.635065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 474/948] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:54.638735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:54.742940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b33ce-61cc-4588-bc48-8ca16c1fb501 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:54.778393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:54.779008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:54.779284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:54.779553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:54.780250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:54.780550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:54.782167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:54.787328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade367-ac9c-451b-b677-182bc531bccb None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:54.787848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade367-ac9c-451b-b677-182bc531bccb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:54.787931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade367-ac9c-451b-b677-182bc531bccb None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:54.789384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 475/949] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:21:54.795826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c395a0-f1bb-43a4-a1ae-33b1006b867c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:54.796355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c395a0-f1bb-43a4-a1ae-33b1006b867c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:54.796693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c395a0-f1bb-43a4-a1ae-33b1006b867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:54.812561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 475/950] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:54.816970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f3c395a0-f1bb-43a4-a1ae-33b1006b867c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:54.818260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f3c395a0-f1bb-43a4-a1ae-33b1006b867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:54.906540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 476/951] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:55.181962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.210460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.285539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0028a-6cd1-4fda-bd7a-0238e5fad509 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.286204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0028a-6cd1-4fda-bd7a-0238e5fad509 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.286694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0028a-6cd1-4fda-bd7a-0238e5fad509 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.288592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 477/952] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:55.291520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd6524-a9f8-4c54-ae62-bdde03dea347 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:55.295540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.296114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.296610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.316869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:55.318413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:55.334046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:55.334680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.334953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.335221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.350819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:21:55.357617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:55.358642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:21:55.359553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:55.363871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 476/953] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:55.365749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.366022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.407882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 478/954] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:55.463174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.479829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a43a-b452-4ce9-91fc-eaafaa36e620 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:55.516295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:55.516903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.517231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.517503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.518216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:55.518517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:55.519892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:55.533440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 477/955] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:55.534785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.640497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7cbe-8223-4be5-aaee-6dd551b31cd6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:55.677056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:55.677686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.677958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.678223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.689282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:55.690781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:55.706257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:55.707263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:55.708250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:55.708250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:55.708250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:55.711904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 479/956] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:55.714390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.721138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.749218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.826734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3066c7-9e52-4525-bacc-4c5abbd90f6e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:55.829134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3a5f-b43d-4989-a845-6d9ddc14e53d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:55.864120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:55.864729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.865004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.865273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.865906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:55.866207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:55.867087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:55.867557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74e4ef-e340-4b83-8584-4bcc2efe66db None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:55.867751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.868017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.868293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.868932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:55.870491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:55.879497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:55.880594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:21:55.881465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:55.884840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 478/957] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:55.885435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 480/958] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:55.886582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d82e-9cd0-4b7d-b634-17e2c5df0139 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:55.886684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.886889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d82e-9cd0-4b7d-b634-17e2c5df0139 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:55.887161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d82e-9cd0-4b7d-b634-17e2c5df0139 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:55.892965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 479/959] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:55.892965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d82e-9cd0-4b7d-b634-17e2c5df0139 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:55.902403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.998787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.000988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d82e-9cd0-4b7d-b634-17e2c5df0139 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.013013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ee7f-7463-4fda-be6b-ccbd7968180e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.037425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.038034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.038312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.038584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.039210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:56.039514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.040914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c811a-55fd-47a5-b514-c3cd7252976a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.046089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 480/960] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:56.047242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.047520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.047804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.058229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.058865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.059144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.059412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.066701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:56.067472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.068211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:56.069226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:56.085464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:56.086625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:21:56.087831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:56.096142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 481/961] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:21:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:56.096142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.155842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 481/962] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:56.155842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.156598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.208408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0301fa-4f3b-4231-a1b5-a9a867287f5b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.248893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.249468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.249756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.250028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.250681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:56.250956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.252386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.257631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 482/963] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:56.293157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a8095-ccac-426a-83f3-25b94311e754 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.334051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.334670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.334950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.335217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.335978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:56.336280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.337733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.359101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 482/964] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:56.364644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.384662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.449075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.477594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270e7fd-c8c6-4ab8-b931-5e3f37d0c73c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.514825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.515354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.515631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.515932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.518169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.564671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff3c3-31e8-43e7-8085-c7f12c982a00 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.586967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.588481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.603367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.603947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.605644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.606116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.606585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.607343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.609076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:56.618790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:56.620885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:56.622185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:56.629550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 483/965] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:56.631453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.699823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 483/966] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:56.701068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.745619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32fd23-3422-410d-8a01-302dd675c7c4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.771619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.784696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.785362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.785653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.787809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.787809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:56.787809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.789069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.796391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 484/967] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:56.801754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.810505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7bf5d-a0b2-4d23-ac6f-fe059427b4b1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.829353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:56.857384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.858018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.858603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.858874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.870276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.871719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-35315b13-aedc-4130-bf94-9601d38b9cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:21:56.887157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:56.888297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:21:56.889204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:21:56.889204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:21:56.889204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:56.889204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 484/968] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:56.889776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac94e7-b940-42bc-b100-9091da1ce9d9 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.890040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac94e7-b940-42bc-b100-9091da1ce9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.890308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac94e7-b940-42bc-b100-9091da1ce9d9 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.891796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 485/969] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:56.893664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac94e7-b940-42bc-b100-9091da1ce9d9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:56.925753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09f0-ebc7-4ad7-9571-b8bc456bf33d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:56.963305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:56.964566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.964863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.965202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.965828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:56.966147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:56.967488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32bda-a4a5-4c08-a4d2-b4deb6b79b44 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:56.972652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 485/970] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:56.973713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:56.974254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:56.974520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:56.993746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:56.995227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:57.003424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac94e7-b940-42bc-b100-9091da1ce9d9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.043141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.043670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.043978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.044574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.045382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:57.045716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.047106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.048129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.063961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 486/971] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:57.063961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.083807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 486/972] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:57.083807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.098340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.190279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2d90f-ff20-45af-ba22-ad3e20fc5659 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.193525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9699c3-75c4-4c1d-932d-6d61faeb888b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.226456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.227075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.227440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.227713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.228572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.230032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.230850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.231548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.231958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.232296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.239960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.241515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:21:57.253501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:57.256796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:57.257696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 487/973] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:57.260935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.309202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.317963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 487/974] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:21:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:57.353859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.398133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f66df-8022-46e0-9242-8d18331a5a7b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.442772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.443388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.443664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.443968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.444726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:57.445030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.446530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.454501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.461983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 488/975] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:21:57.469111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.484555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637385a-2120-4c12-a9e3-21af7f101d0c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.533269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.534208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.534669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.535138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.536032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.537668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.540435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING keystone.server.flask.common [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:21:57.576673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.sql.core [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:21:57.576673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:21:57.576673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [parameters: {'user_id': 'ad03a65f4f524df981ab5e188959449b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:21:57.576673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81655) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:57.585715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:57.586749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application yield resource Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise self.value Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application session.commit() Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:21:57.587917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:21:57.589168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:21:57.590228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application result.read() Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:21:57.591172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ad03a65f4f524df981ab5e188959449b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:57.592124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 10:21:57.593232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 488/976] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 24 10:21:57 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:57.594178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.601578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:57.610478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46235-f66b-4f34-9852-d634d0926946 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.656469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.657070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.657348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.657643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.658351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] RBAC: Adding query filter params (role.id=82f3c2795f2640b6807d03aba20096a7, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=bd93883307a1430bafdd32a91157f811) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:57.658653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.660545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.669395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 489/977] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:21:57 2022] GET /identity/v3/role_assignments?user.id=bd93883307a1430bafdd32a91157f811&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=82f3c2795f2640b6807d03aba20096a7 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:57.721803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114099b-d5ed-406d-8616-1bdf48576e48 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.763177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.764212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.764764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.765268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.774026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.776771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e2b74b07-f33e-42fb-9202-57a3d12ca094 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:21:57.790345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:57.791373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:21:57.792945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:21:57.795938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 489/978] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:21:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:21:57.802559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:57.913442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea3ac5-e94f-4477-b3a8-cfa258bc3598 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:57.950739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:57.951347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:57.951617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:57.951917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:57.952612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:21:57.952914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:57.954336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c3516-7bdd-4a9d-bdf7-5fbc2a8cabd0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:57.992332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 490/979] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 24 10:21:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:21:58.321531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0f1f-9396-4a75-ba65-acfe3c623933 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:58.322019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0f1f-9396-4a75-ba65-acfe3c623933 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:58.322100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0f1f-9396-4a75-ba65-acfe3c623933 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:58.327198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 490/980] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:58.332305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d29f-4274-4d3c-abda-f2ad928d4e7b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:58.332593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d29f-4274-4d3c-abda-f2ad928d4e7b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:58.332866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d29f-4274-4d3c-abda-f2ad928d4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:58.353182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a50d29f-4274-4d3c-abda-f2ad928d4e7b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:58.354414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a50d29f-4274-4d3c-abda-f2ad928d4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:58.369451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:58.423219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 491/981] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:58.688596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0f1f-9396-4a75-ba65-acfe3c623933 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:58.691487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:58.803310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0f1f-9396-4a75-ba65-acfe3c623933 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:58.840537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:58.841508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:58.842001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:58.842463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:58.843321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:58.844919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf32684-8043-4725-aa5e-9607779b2d61 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:58.976031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 491/982] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:21:58 2022] POST /identity/v3/services => generated 242 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:21:59.359628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed268a-fc2f-4e0e-add2-795deaaaeb03 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:59.360197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed268a-fc2f-4e0e-add2-795deaaaeb03 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:59.360197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed268a-fc2f-4e0e-add2-795deaaaeb03 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:59.361677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 492/983] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:59.367252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019cb5-bab4-474d-8970-12c07ef5ea6d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:59.367652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019cb5-bab4-474d-8970-12c07ef5ea6d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:59.367861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019cb5-bab4-474d-8970-12c07ef5ea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:59.386585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-aa019cb5-bab4-474d-8970-12c07ef5ea6d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:59.388140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-aa019cb5-bab4-474d-8970-12c07ef5ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:59.448877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:59.467835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 492/984] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:59.681400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4346-1c05-49ff-ba4f-3e0080b0eb06 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:59.681710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4346-1c05-49ff-ba4f-3e0080b0eb06 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:59.681984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4346-1c05-49ff-ba4f-3e0080b0eb06 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:59.684469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 493/985] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:21:59.689616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:59.689974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:59.690324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:59.708951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:21:59.710186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:21:59.739742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4346-1c05-49ff-ba4f-3e0080b0eb06 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:21:59.780548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 493/986] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:21:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:21:59.854651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4346-1c05-49ff-ba4f-3e0080b0eb06 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:21:59.890746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:21:59.891680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:21:59.892124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:21:59.892544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:21:59.893283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:21:59.894795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:21:59.904043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:21:59.905229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:21:59.906271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:21:59.908658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 494/987] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:21:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:21:59.914505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.019354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44807085-ce3d-4872-a28e-70912d7d1e62 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.037388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:00.049526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.055588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.056232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.056514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.056781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.058158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:00.058513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.060381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.070540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 494/988] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:21:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:00.071472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.071608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:00.160069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcff3b-ad30-4f04-bdeb-78610d6a241f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.181489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bf89-bfbd-41ce-8675-cc420d4cdcde None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.195491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.196138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.196420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.196690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] PATH_INFO: `/v3/services/image` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.197285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.198749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:00.207286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:00.208335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:00.209198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 495/989] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:00.214877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.219962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.220569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.220848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.221120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.221744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:00.222043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.223397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.233571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 495/990] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:00.234448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.283267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:00.301102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:00.324478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f32e-d081-4ba9-9f39-51a4fce79470 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.349135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4c21-64db-4ad6-b66d-4045316354ec None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.361723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.362322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.362603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.362874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.363506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] RBAC: Adding query filter params (name=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:00.363829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.365185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.370294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 496/991] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:00.375877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.386691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.387293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.387625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.387916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.388781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] RBAC: Adding query filter params (interface=admin, service_id=8f00167890b5426898ee31ec1439727e, region_id=RegionOne) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:00.389090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.390438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.400094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 496/992] 10.222.0.50 () {56 vars in 1249 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/endpoints?service_id=8f00167890b5426898ee31ec1439727e&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:00.402445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:00.481557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ebb6-c8c8-4eec-9ba8-8c717e125270 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.506364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc573e-c12b-4333-9ed1-10b071de54c2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:00.518496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:00.519165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.519810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.520114 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.520391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.520976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] RBAC: Adding query filter params (type=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:00.521276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.522641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bea56c-3d93-4239-aa15-a2ea481b2912 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.527818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 497/993] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:00.550437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:00.550982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.551256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.551524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.552177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:00.553584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360d97-ae3e-4063-b5f6-f794264d0ba5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:00.561520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 497/994] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:22:00 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:22:00.942852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330015-b45c-4d15-abf5-19739d89403c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.943171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330015-b45c-4d15-abf5-19739d89403c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.943411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330015-b45c-4d15-abf5-19739d89403c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.944825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 498/995] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:00.950287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:00.950571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:00.950852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:00.969763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:00.970952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:01.042781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 498/996] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:01.312342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330015-b45c-4d15-abf5-19739d89403c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:01.321300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:01.415732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330015-b45c-4d15-abf5-19739d89403c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:01.450584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:01.451213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:01.451475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:01.451741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:01.452347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:01.453696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:01.462392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:01.463500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:01.464973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:01.467861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 499/997] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:22:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:01.469647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:01.571975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fd82-51bf-4113-9304-ad0883ca23ce None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:01.574554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:01.607938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:01.608548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:01.608826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:01.609097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:01.609719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:01.610018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:01.611386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:01.622663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 499/998] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:22:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:01.624109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:01.700558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:01.734234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c286b-bbaf-402f-aff6-433b06bf784d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:01.767808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:01.768409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:01.768686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:01.768953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:01.769574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:01.769875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:01.771221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:01.781385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 500/999] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:22:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:01.782905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:01.884725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41ce9b-4f10-4eee-9c10-2f9a90a14625 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:01.918822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:01.919416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:01.919691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:01.919985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:01.920677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] RBAC: Adding query filter params (interface=public, service_id=a5cf7b0c08e346949a6c1ecb37fe8fce, region_id=RegionOne) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:01.920981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:01.922331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25ff48-ba53-4c8b-8936-b45e0acfd7f4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:01.931851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 500/1000] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:22:01 2022] GET /identity/v3/endpoints?service_id=a5cf7b0c08e346949a6c1ecb37fe8fce&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:01.934052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:02.037733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342750bc-ec58-4248-8b5f-26cdda00ba83 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:02.072458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:02.073655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.073944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.074288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.074898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:02.076391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c55f45-c373-4ae6-9c04-7a76fe35bffb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:02.077461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.083827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 501/1001] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:22:01 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:22:02.480236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da761b9-53ce-42af-bed8-6575019199c9 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.480760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da761b9-53ce-42af-bed8-6575019199c9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.480760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da761b9-53ce-42af-bed8-6575019199c9 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.482282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 501/1002] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:02.487531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.487998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.488280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.507582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:02.508817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:02.516116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1425-d18e-48ab-85b7-1c79594416bf None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.516403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1425-d18e-48ab-85b7-1c79594416bf None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.516659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1425-d18e-48ab-85b7-1c79594416bf None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.518341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 502/1003] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:02.522977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.523290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.523563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.541586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:02.542747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:02.569529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.585609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 502/1004] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:02.611596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 503/1005] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:02.852888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:02.885429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:02.956322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041eed9-693a-4cea-9378-7c21a224bf3f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:02.984172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:02.992546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:02.993160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:02.993440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:02.993711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:02.994370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:02.995201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8392-14b9-4b82-a672-606b7d64e702 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:02.996675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:03.031637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:03.032284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:03.032556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:03.032819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:03.033391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:03.034749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:03.043726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:03.045108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:03.046042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 504/1006] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 24 10:22:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:03.050780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:03.078293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:03.110012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 503/1007] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:22:02 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:03.157274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d32c2-509c-4587-9a02-15ea442b28f1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:03.204521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:03.205146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:03.205403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:03.205664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:03.206286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:03.206581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:03.208024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:03.219092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 505/1008] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:22:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:03.219958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:03.330714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9978d-9fc0-46d7-8b34-d93130591a2c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:03.365718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:03.366246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:03.366521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:03.366782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:03.367406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:03.367705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:03.369080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e086a0-7095-4501-b461-396b5f5c7c8f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:03.379494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 504/1009] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 24 10:22:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:03.381044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:03.469637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:03.485096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3eca7d-f48f-47e0-ab02-2bc36e2d1893 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:03.519651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:03.520280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:03.520556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:03.520825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:03.521486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:03.522844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c410-4a78-42ef-b958-f8e04fe0b269 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:03.590174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 506/1010] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:22:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:22:04.036844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637146-7355-4523-a9fe-962cf61184c7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:04.037401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637146-7355-4523-a9fe-962cf61184c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:04.037401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637146-7355-4523-a9fe-962cf61184c7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:04.038773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 505/1011] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:04.044610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:04.044896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:04.045171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:04.063418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:04.064629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:04.139652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 507/1012] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:04.409238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637146-7355-4523-a9fe-962cf61184c7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:04.464339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:04.514187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637146-7355-4523-a9fe-962cf61184c7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:04.549195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:04.549872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:04.550099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:04.550368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:04.550945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:04.552334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:04.561284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:04.562305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:22:04.563257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:04.570451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 506/1013] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:22:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:04.570586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:04.643079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:04.675740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131a733-2b06-4b48-9b2f-a4a7e96d25ff None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:04.714142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:04.714746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:04.715019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:04.715286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:04.715939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:04.716236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:04.717618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:04.727821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 508/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:22:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:04.729103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:04.832441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e108-6205-4d3e-8276-745d9d582771 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:04.849024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:04.867757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:04.868387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:04.868673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:04.868945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:04.869761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:04.870103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:04.871506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede52cb-11c0-4276-90a5-f6a918ac69b7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:04.882971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 507/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 24 10:22:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:04.884225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:04.987263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c499-341b-4e37-9a56-654af9b8e572 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:05.022568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:05.023184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.023620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.023925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.024577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:05.026117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:05.031552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:05.080121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb75b5c-be75-4751-9c8f-25e435efbd9b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.080661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb75b5c-be75-4751-9c8f-25e435efbd9b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.080661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb75b5c-be75-4751-9c8f-25e435efbd9b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.082095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 508/1016] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:05.087011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bd2-e8dc-47b6-b852-d7f711ab559f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.087239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bd2-e8dc-47b6-b852-d7f711ab559f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.087512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336bd2-e8dc-47b6-b852-d7f711ab559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.106775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-29336bd2-e8dc-47b6-b852-d7f711ab559f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:05.107986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29336bd2-e8dc-47b6-b852-d7f711ab559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:05.164603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 509/1017] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:22:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:05.197192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 509/1018] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:05.464072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:05.517517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb31b-6d14-4bb4-931b-897fd3e0b001 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.517833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb31b-6d14-4bb4-931b-897fd3e0b001 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.518080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb31b-6d14-4bb4-931b-897fd3e0b001 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.520093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 510/1019] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:05.527966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.528249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.528881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.550915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:05.552439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:05.567962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fadd84-bdf1-4b12-9ecc-37b839e6e693 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:05.603050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:05.603678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.604639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.604909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] PATH_INFO: `/v3/services/image` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.605592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:05.606899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:05.615915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:05.618665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:05.620387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 510/1020] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 24 10:22:05 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:05.624702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:05.644921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 511/1021] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:05.685678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:05.732350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb6e62-2053-4107-ad13-ee58f3c81fea None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:05.766907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:05.767507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.767801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.768082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.768705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] RBAC: Adding query filter params (name=image) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:05.769005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:05.770370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:05.780238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 511/1022] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:05.781815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:05.817462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:05.883419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bec3e-2bd5-4684-baa7-8c3dc9a5340a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:05.914159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:05.921388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:05.922000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:05.922282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:05.922554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:05.923189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:05.923491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:05.924892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:05.934744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 512/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:05.936522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:06.029713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541df6cc-2d37-487e-8a75-7de3c830ba9f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:06.050034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:06.052215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:06.053373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520b91-bb93-426c-9c45-cfa5ceda3dd9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:06.066057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:06.066688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:06.066969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:06.067240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:06.068351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:06.069787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:06.071687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 512/1024] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:06.077773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:06.092265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:06.092953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:06.093148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:06.093418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:06.094117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] RBAC: Adding query filter params (interface=public, service_id=dc43be74131a49848360bc27831282b5, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:06.094425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:06.095846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:06.101515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 513/1025] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:22:05 2022] GET /identity/v3/endpoints?service_id=dc43be74131a49848360bc27831282b5&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:06.107141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:06.188513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2e3d-56ac-4eaa-b922-58efebd349bf None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:06.218758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398b4-e13f-4fae-b284-5656dc62f425 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:06.224304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:06.224918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:06.225197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:06.225468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:06.226108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:06.227541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e873a-17b7-4e63-bc5b-1236949f92dc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:06.256911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:06.262865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:06.262865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:06.262865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:06.262865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:06.262865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517c1a-e299-4c17-8ddb-adb1ac7be3e4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:06.266834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 514/1026] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:22:06 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:22:06.322272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 513/1027] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:22:06 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:22:07.210380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a112-8607-42ed-8491-7d672c6e5bf8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:07.210902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a112-8607-42ed-8491-7d672c6e5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:07.210902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a112-8607-42ed-8491-7d672c6e5bf8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:07.212332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 515/1028] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:07.218413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:07.218832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:07.219021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:07.238652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:07.239875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:07.276109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:07.319835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 514/1029] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:07.599820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762a112-8607-42ed-8491-7d672c6e5bf8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:07.631835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:07.706979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762a112-8607-42ed-8491-7d672c6e5bf8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:07.742973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:07.743603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:07.743910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:07.744185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:07.754704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:07.759374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:07.760326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:07.761198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:07.762447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 516/1030] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:22:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:07.766842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:07.869528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1388f-2c17-4497-b7fb-5f96ad190bd5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:07.904363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:07.904966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:07.905239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:07.905503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:07.906154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:07.906447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:07.907833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:07.921246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 515/1031] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:22:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:07.922439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.012697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.025036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ebbdf-fd93-41cd-9c14-39c9865caadb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.060056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.060681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.060955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.061220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.080020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.081515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-edcaad26-cea1-4070-8145-7d5aa7c7a614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:08.099851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:08.100858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:08.101789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:08.101789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:08.101789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:08.101789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 517/1032] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:08.108391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.143190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.203051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128e9d9-5cdb-458e-84de-ba88f738cf30 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.203380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128e9d9-5cdb-458e-84de-ba88f738cf30 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.203601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128e9d9-5cdb-458e-84de-ba88f738cf30 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.205126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 518/1033] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:08.209859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800ff-fb40-4321-9f13-0b344c6c80db None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.210150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800ff-fb40-4321-9f13-0b344c6c80db None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.210424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800ff-fb40-4321-9f13-0b344c6c80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.219031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dc48-1744-42c9-b38b-b40ba5090941 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.229026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-726800ff-fb40-4321-9f13-0b344c6c80db None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:08.230212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-726800ff-fb40-4321-9f13-0b344c6c80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:08.256031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.256641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.256924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.257194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.257836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:08.258139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.259505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.276691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 516/1034] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:08.277986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.306004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 519/1035] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:08.310091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cdcfd-c193-4045-94e6-c8bbbe57d3e2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.310091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cdcfd-c193-4045-94e6-c8bbbe57d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.310091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cdcfd-c193-4045-94e6-c8bbbe57d3e2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.310091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 520/1036] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:08.314716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.315143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.315413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.334044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:08.335233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:08.390018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.401950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.402295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684249-c788-413b-b4ad-7ef1b53ecfc8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.406625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 521/1037] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:08.436149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.436772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.437097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.437361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.444401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.445988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:22:08.457807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:08.458808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:08.459810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 517/1038] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:08.464824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.564549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9747a1e-cf38-4c2f-9412-667b7566bd25 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.576319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.601730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.602386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.602616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.607343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.607343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:08.607343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.607343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.623717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 522/1039] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:08.629184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.685572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b775714-f26b-4ff3-bc04-ec90c9771bfe None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.696040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.719350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.720099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.720438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.720716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] PATH_INFO: `/v3/services/image` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.721295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.722645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:08.731835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:08.732964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:08.733826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 518/1040] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:08.735078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.741272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29c08-59d9-49fb-8cc8-a9eba41c593d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.752879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.775698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.776342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.776617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.776887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.832098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50196829-d428-4f57-a07d-d72fe9802b34 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:08.845056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.846495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.865687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:08.866296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:08.866566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:08.866828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:08.867945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:08.869344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:08.871591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 519/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:08.872454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.904297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.952375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 523/1042] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:22:08.952375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:08.959373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:08.975166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a900-c8a8-4aee-a1d1-070534333431 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.011155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.011748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.012056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.012325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.012931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:09.013223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.014603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.020091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 520/1043] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:09.020856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.051634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f078-4e00-4a0a-933a-ae0090113ff8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.087172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.087767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.088080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.088545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.089326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.090753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.120877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab785d-c695-4c60-8ed2-213c98ebe8dd None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.153969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.154591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.154868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.155138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.165554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.167942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.171337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 524/1044] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:22:08 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:09.172189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.176393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:09.183151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:09.184244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:09.185176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:09.185176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:09.185176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:09.185176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 521/1045] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:09.199417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.203137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.308046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bbb5f-fdfb-4d7b-a477-d1c01f8954e1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.309337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c1974-d5c3-4501-b93f-fc2a0f38f11e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.351057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.351294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.351665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.352491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.352602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.352681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.352772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.352772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.352903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:09.353149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.353250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] RBAC: Adding query filter params (type=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:09.353583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.355076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.355523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.360738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 525/1046] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:09.366221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.369302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 522/1047] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:09.376224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.440921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.479141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.482209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c135a-a83c-4200-94dc-2c38c8e03e1b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.482382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7db7f-576f-42af-b515-2c90cc29e099 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.518228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.518452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.518833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.518954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.519124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.519220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.519364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.519464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.520094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.521424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.526478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.528026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:22:09.540142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:09.544384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:09.545468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 523/1048] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:09.547610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.604271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 526/1049] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:22:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:22:09.660884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb88f3-e0c0-488c-ab5b-f5ad628a0a0d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.686948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.709972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.710752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.711131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.711553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.712400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:09.712808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.714569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7610eb-158b-46ca-9e46-ccd7ff1a91d1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.729768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 524/1050] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:09.735986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:09.847203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff123-1bb8-407d-a2c5-e244a342a23f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:09.883286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:09.883943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:09.884218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:09.884483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:09.885356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] RBAC: Adding query filter params (role.id=82f3c2795f2640b6807d03aba20096a7, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:09.885664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:09.887079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385788e7-7a3c-4679-a702-f35c87f8fcdc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:09.889051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:09.893298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 527/1051] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:09 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=82f3c2795f2640b6807d03aba20096a7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:11.186552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b451c-d4c0-4b13-8dcb-0cf8d5877980 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.187100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b451c-d4c0-4b13-8dcb-0cf8d5877980 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.187100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b451c-d4c0-4b13-8dcb-0cf8d5877980 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.188729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 525/1052] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:11.193949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995ad8-c956-4f71-a665-42f3fb59e2ec None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.194363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995ad8-c956-4f71-a665-42f3fb59e2ec None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.194620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5995ad8-c956-4f71-a665-42f3fb59e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.214202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a5995ad8-c956-4f71-a665-42f3fb59e2ec None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:11.215537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a5995ad8-c956-4f71-a665-42f3fb59e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:11.285894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 528/1053] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:11.553860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b451c-d4c0-4b13-8dcb-0cf8d5877980 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:11.562421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03454-84e8-478c-baa0-c856d6cb4aef None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.562707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03454-84e8-478c-baa0-c856d6cb4aef None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.562974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03454-84e8-478c-baa0-c856d6cb4aef None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.564476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 529/1054] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:11.569363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.569646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.570020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.588660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:11.589848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:11.659215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b451c-d4c0-4b13-8dcb-0cf8d5877980 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:11.661063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 530/1055] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:11.693679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:11.694305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.694580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.694848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.705558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-1a331c58-6eb6-4a89-8ad7-2d90a40181d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:11.710210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:11.711157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:11.712071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:11.716122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 526/1056] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:11.717808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:11.778213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:11.810024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f8ce6-56ca-429c-b0d4-d46bc76fdab7 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.810319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f8ce6-56ca-429c-b0d4-d46bc76fdab7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.810501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f8ce6-56ca-429c-b0d4-d46bc76fdab7 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.811976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 527/1057] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:11.816969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.817245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.817518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.824707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d9ad-9c6b-4794-be9c-843c9c5fe07f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:11.839469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:11.841325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:11.860006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:11.860613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:11.860890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:11.861154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:11.861811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:11.862109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:11.863456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:11.876086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 531/1058] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:11.876235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:11.877694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:11.922399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 528/1059] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:11.931490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:11.985760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043079-e671-4d7d-a9d8-7c3167685d80 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.004786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.023823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.024442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.024743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.024987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] PATH_INFO: `/v3/users/8f7c3f755cca45f982e33d4c7ab69953` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.039089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7b42c-028b-45d2-af4a-d96ca2f25eb6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.040057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7c3f755cca45f982e33d4c7ab69953)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.041522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.043164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 532/1060] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:11 2022] GET /identity/v3/users/8f7c3f755cca45f982e33d4c7ab69953 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:12.048850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.077912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.078432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.078711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.078981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.115522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.153465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.155148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.160356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7575-30fb-47f3-b05b-e2c04231eb16 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.196707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.197354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.197689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.197982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.247204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.265164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 529/1061] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:22:12.266020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.271307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.272770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.331418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.366421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b5a2-073c-4f9b-a7da-96103a98b772 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.376205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 533/1062] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:22:12.377047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.406817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.407436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.407713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.408081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.418814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:12.423988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:12.424933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:12.425801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 530/1063] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:12.426502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.452173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.473152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a2f2-030c-4ace-931e-6e10672d4dfb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.506919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.507531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.507825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.508096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.518771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.520225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.533431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976100ae-cb6c-4cf7-a879-ca74baea9ede None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:12.537201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:12.538225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:12.539162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:12.539162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:12.539162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:12.539162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 534/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:12.539162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.561840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.570183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.571640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.571640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.571640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.573084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.574458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.576130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 531/1065] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:12.576882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.639573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af13f2-5443-4f6d-bc83-9c0ab2511c76 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.668159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.674050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.674753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.674920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.675193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.675896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:12.676199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.677595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.678622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ecb-9f60-4572-ac96-5a916ff917eb None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.686677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 535/1066] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:12.687553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.714557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.715158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.715435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.715708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.716379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:12.716682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.718048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.730440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 532/1067] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:12.731236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:12.794568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.807823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7184-6715-4e1c-a977-699d5608da4c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.846039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.846652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.846930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.847148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edcc5-840d-430a-9d27-34e3c7523444 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:12.847253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.847984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=f6560583ed884ee295c33da802f65428, user.id=8f7c3f755cca45f982e33d4c7ab69953) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:12.848296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.850015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.866148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 536/1068] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/role_assignments?user.id=8f7c3f755cca45f982e33d4c7ab69953&scope.project.id=f6560583ed884ee295c33da802f65428&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:12.899741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:12.900345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:12.901162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:12.901509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:12.914383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:12.915899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:12.934039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:12.935138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:12.936134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:12.936134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:12.936134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:12.936474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 533/1069] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:12.942160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.012346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.059186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41907335-f9a5-4da8-86d5-7b0649b62aeb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.095660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.096294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.096573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.096844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.097482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:13.097783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.099399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.111876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 537/1070] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:13.117521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.218173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db0212-a155-4010-8ffb-7a5daddcb57b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.225316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.252296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.252993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.253276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.253550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.261315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.263024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:22:13.274431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:13.276483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:13.277484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 534/1071] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:13.281994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.383864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ad16-bfe2-41d1-a017-5e7738245732 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.401939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.419083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.419680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.419986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.420261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.421003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:13.421308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.422724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.440434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 538/1072] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:13.446008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.544555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df5cd-f86f-4358-8d78-7b98d71a3ae3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.576818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.577436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.577713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.577981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.588794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.590208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:13.604853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:13.607030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:13.608189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:13.608189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:13.608189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:13.608189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 535/1073] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:13.611749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.716108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e51a-78a5-4a43-bae6-f0c376a9153e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.749303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.749896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.750171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.750439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.751072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:13.751371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.752748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.763639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 539/1074] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:13.769231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.789710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.871972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1e344-a16c-4140-a878-e28bd787060d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:13.905856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:13.906498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:13.906773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:13.907042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:13.914642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:13.916162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:22:13.928291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:13.929358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:13.935935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 536/1075] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:13.936440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:13.970029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:14.035408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21d3d-6382-403f-9693-e9d810937590 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:14.068277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:14.068864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:14.069137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:14.069401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:14.070080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:14.070378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:14.071880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b57f8-e229-47d3-9a54-5a1978e54a58 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:14.083876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 540/1076] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:14.090525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:14.167199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:14.187832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e769c16-6a40-40ba-b1bc-5beea74e54c4 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:14.221643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:14.222293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:14.222575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:14.222843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/82f3c2795f2640b6807d03aba20096a7` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:14.225241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=1b0807da1ad345eb9de13973cae6bfd8, role_id=82f3c2795f2640b6807d03aba20096a7)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:14.226661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfb49c-cd75-4042-bad9-ca223fa3d0bc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:14.313207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 537/1077] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:22:14 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/1b0807da1ad345eb9de13973cae6bfd8/roles/82f3c2795f2640b6807d03aba20096a7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:22:14.764110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bbef-6a59-4f63-8a24-2e4274032aa9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:14.764635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bbef-6a59-4f63-8a24-2e4274032aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:14.764635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bbef-6a59-4f63-8a24-2e4274032aa9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:14.765976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 541/1078] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:14.771145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:14.771427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:14.771699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:14.790336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:14.792085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:14.857973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 538/1079] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:15.128275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bbef-6a59-4f63-8a24-2e4274032aa9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:15.219964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:15.227202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bbef-6a59-4f63-8a24-2e4274032aa9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:15.260267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:15.260911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:15.261193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:15.261458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:15.271470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:15.277539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:15.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:15.279527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 542/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:15.284736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:15.350938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:15.386803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567fc1-5d95-4512-81d6-c7adeb9192aa None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:15.422469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:15.423073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:15.423350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:15.423615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:15.424303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:15.424602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:15.425958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:15.434055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 539/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:15.439861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:15.537258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7ea4-7ea6-4b7f-99c3-4bdcb6851316 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:15.569212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:15.569823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:15.570095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:15.570358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] PATH_INFO: `/v3/users/8f7c3f755cca45f982e33d4c7ab69953` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:15.571450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7c3f755cca45f982e33d4c7ab69953)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:15.573408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:15.574961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 543/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:15 2022] GET /identity/v3/users/8f7c3f755cca45f982e33d4c7ab69953 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:15.580713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:15.682609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195882-d9f0-47b4-bbc7-695898fe8ce6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:15.710188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:15.716080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:15.716703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:15.716981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:15.717302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:15.718368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:15.719810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff20f3e-c160-4673-88e0-68228d6a38e3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:15.721447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 540/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:15 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:15.728251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:15.753846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:15.827905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0d92-c449-47c4-a363-d712f53d67f7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:15.861025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:15.861667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:15.861938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:15.862201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428/users/8f7c3f755cca45f982e33d4c7ab69953/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:15.864144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6560583ed884ee295c33da802f65428, user_id=8f7c3f755cca45f982e33d4c7ab69953, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:15.865562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41f5f6-32d3-4614-8acc-786c09e6c3f0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:15.936575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 544/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:22:15 2022] PUT /identity/v3/projects/f6560583ed884ee295c33da802f65428/users/8f7c3f755cca45f982e33d4c7ab69953/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:22:16.243142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07900-bc74-4d62-9024-8207926a048a None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:16.243449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07900-bc74-4d62-9024-8207926a048a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:16.243729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07900-bc74-4d62-9024-8207926a048a None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:16.245579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 541/1085] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:16.250833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:16.251117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:16.251392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:16.269837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:16.271015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:16.341924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 545/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:16.615590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07900-bc74-4d62-9024-8207926a048a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:16.712098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07900-bc74-4d62-9024-8207926a048a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:16.745666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:16.746276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:16.746553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:16.746821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:16.756859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:16.761762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:16.762772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:16.763629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 542/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 24 10:22:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:16.768910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:16.783212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:16.868866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86cf3f-8520-4168-848f-7fceb9b6f4f1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:16.904010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:16.904607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:16.904879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:16.905145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:16.905906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:16.906206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:16.907548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:16.915514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 546/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:22:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:16.921802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:16.982940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:17.026831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ef78-a586-49e2-b4a1-091152f9ad0c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:17.060152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:17.060775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.061050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.061318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.071564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:17.073250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:17.086809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:17.087902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:17.089073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:17.089073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:17.089073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:17.089073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 543/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:17.093983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:17.170422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:17.195541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd9d7-82f5-4517-88dd-c6392224408c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:17.230179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:17.230780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.231064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.231329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.231989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:17.232290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:17.233676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:17.245707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 547/1090] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:17.251334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:17.351340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f4b67-f3f9-4ebf-ba07-337f8d19348a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:17.361919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:17.384886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:17.385584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.385873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.386142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.393622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:17.395052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:22:17.406790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:17.412931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:17.414071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 544/1091] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 24 10:22:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:17.414671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:17.510951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50e36f-a972-45d1-b994-964be53d4807 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:17.551249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:17.551875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.552154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.552420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.553132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:17.553429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:17.554825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ed1a-9f1e-403a-9456-d689b18853b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:17.556445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:17.572691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 548/1092] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 24 10:22:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:17.578428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:17.699641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e8a77-23e4-43c0-86cf-e0d5026ea674 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:17.732998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:17.733593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.733873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.734137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.772090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:17.799474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:17.801043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:17.833058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f064f-a98c-4b3b-99ec-060457b96c07 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.833450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f064f-a98c-4b3b-99ec-060457b96c07 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.833714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f064f-a98c-4b3b-99ec-060457b96c07 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.835046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 549/1093] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:22:17.840716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:17.840991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:17.841259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:17.859657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:17.860860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:17.898670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 545/1094] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:17.905078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:17.926957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 550/1095] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:17.970818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.001029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056977d-f8bf-49d0-828b-0613456161f6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.033963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.034520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.034795 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.035063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.045980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.047415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:18.061576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:18.062550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:22:18.068307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:18.068307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:22:18.068307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:18.068307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 546/1096] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:18.068536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.181085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf03fd-e2c2-4df8-a680-8a10604b4bfa None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.195175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.203635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.215559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.216190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.217315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.217315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.217488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:18.217678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.219025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.235912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 551/1097] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:18.237309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.297497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8cdd4-1b45-43b9-89ab-25fd1d05b85d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.321072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.333066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.333691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.333967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.334242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.337109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37106b-9fdf-4821-a722-5d964a9bab7f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.345622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:18.350769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:18.351689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:18.356464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 547/1098] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:22:18.358538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.371312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.372111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.372390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.372659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.379151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.380613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:22:18.392097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:18.393069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:18.393979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 552/1099] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:18.399015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.443945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.455401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5136f-03a5-4750-97c0-b153a0e47add None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.490284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.510456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.511018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c370a-88d5-46fd-8516-d4842463caaf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.511109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 548/1100] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:18.511109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.536612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.537218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.537499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.537771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.538456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:18.538759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.540208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.552062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 553/1101] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:18.556454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.558069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.611247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96977d4-0344-44e6-b6a4-3ba16d4a134e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.645263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.645882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.646155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.646419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] PATH_INFO: `/v3/users/8f7c3f755cca45f982e33d4c7ab69953` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.647517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7c3f755cca45f982e33d4c7ab69953)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.648976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.651132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 549/1102] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/users/8f7c3f755cca45f982e33d4c7ab69953 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:18.657054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:18.659103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e42d61-1bc1-4c47-ae7a-77f360080fd2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.660670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.694312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.694915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.695195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.695467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.696227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] RBAC: Adding query filter params (role.id=82f3c2795f2640b6807d03aba20096a7, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=1b0807da1ad345eb9de13973cae6bfd8) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:18.696536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.698705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.705328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 554/1103] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/role_assignments?user.id=1b0807da1ad345eb9de13973cae6bfd8&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=82f3c2795f2640b6807d03aba20096a7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:18.763140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc78e7-1362-4afc-8d53-5dd20c0e1b73 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:18.777928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:18.800101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:18.800713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:18.800987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:18.801255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:18.872315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:18.873690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:18.974236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 550/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:22:18.980465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:19.083432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e9818-7331-4ea6-881a-2401e9dbee97 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:19.117828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:19.118456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:19.118727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:19.118991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:19.120745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:19.122192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94756f-4376-427b-b100-a8dccf1492c5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:19.123919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 555/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:18 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:19.131233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:19.146791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:19.236191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c370-4ed8-4c97-bec5-ceabd037dea0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:19.271205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:19.271851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:19.272132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:19.272406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:19.273129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=f6560583ed884ee295c33da802f65428, user.id=8f7c3f755cca45f982e33d4c7ab69953) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:19.273431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:19.274854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f066-af5e-4c45-94b1-dcf6082d3adb None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:19.281908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 551/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:19 2022] GET /identity/v3/role_assignments?user.id=8f7c3f755cca45f982e33d4c7ab69953&scope.project.id=f6560583ed884ee295c33da802f65428&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:21.246971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271115f-c4e1-400d-98e0-bc9164459d44 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:21.247505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271115f-c4e1-400d-98e0-bc9164459d44 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:21.247505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271115f-c4e1-400d-98e0-bc9164459d44 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:21.248885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 556/1107] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:21.254082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:21.254500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:21.254627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:21.273225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:21.274401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:21.339506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 552/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:22:21.614489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271115f-c4e1-400d-98e0-bc9164459d44 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:21.646526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:21.711340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271115f-c4e1-400d-98e0-bc9164459d44 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:21.745018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:21.745625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:21.745898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:21.746162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:21.747243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:21.748682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde68256-c439-422f-b930-2bc7f7e9bec7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:21.750235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 557/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:21.756124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:21.764272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:21.853377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb5a86-0d01-4ebd-a263-d8496fbbf918 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:21.886796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:21.887323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:21.887597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:21.887890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:21.888527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:21.889941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a2af4-6e5d-4526-ba81-4693aef42886 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:22.004021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 553/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:22:21 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:23.934363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898bbc-6273-47e0-ad25-8285c410cb3f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:23.935005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898bbc-6273-47e0-ad25-8285c410cb3f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:23.935005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898bbc-6273-47e0-ad25-8285c410cb3f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:23.936243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 558/1111] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:23.941381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:23.941806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:23.941910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:23.959653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:23.960852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:24.016333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:24.026347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 554/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:24.298168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898bbc-6273-47e0-ad25-8285c410cb3f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:24.402194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898bbc-6273-47e0-ad25-8285c410cb3f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:24.403704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:24.436804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:24.437459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:24.437950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:24.438391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] PATH_INFO: `/v3/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:24.440183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] RBAC: Authorizing `identity:get_role(role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:24.441533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:24.442852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 559/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:24 2022] GET /identity/v3/roles/040e823c6d874b98830778582091d28a => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:24.448829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:24.545749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f119abe-54e9-4496-96c1-5d1f96b599ae None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:24.578893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:24.579452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:24.579729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:24.580029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] PATH_INFO: `/v3/users/112353131cd04511b8ed8c224c98e3f4` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:24.593036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] RBAC: Authorizing `identity:get_user(user_id=112353131cd04511b8ed8c224c98e3f4)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:24.594471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:24.596248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 555/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:24 2022] GET /identity/v3/users/112353131cd04511b8ed8c224c98e3f4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:24.602254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:24.699711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e1dd8-0bb6-4c98-a3fb-2a797885d9ba None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:24.733718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:24.734309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:24.734583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:24.734847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:24.773000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:24.801108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:24.802528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:24.898349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 560/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:24.904253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:24.952498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:25.000087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb1a2-c48b-4ba1-95f9-298469cf34b0 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:25.032668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:25.033283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:25.033561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:25.033832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:25.034936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:25.036391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474b370-5500-4b37-87ce-d3c83692b46e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:25.038006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 556/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:24 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:25.044610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:25.111655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:25.141454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f423a-074b-4ab8-b39b-cbef39d55e1c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:25.173750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:25.174338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:25.174607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:25.174866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:25.175568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=f6560583ed884ee295c33da802f65428, user.id=112353131cd04511b8ed8c224c98e3f4) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:25.175888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:25.177713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487da21-dd83-497d-ac54-55006c214abf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:25.183098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 561/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:25 2022] GET /identity/v3/role_assignments?user.id=112353131cd04511b8ed8c224c98e3f4&scope.project.id=f6560583ed884ee295c33da802f65428&role.id=040e823c6d874b98830778582091d28a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:27.042315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335981-1c3b-4173-bf28-3a1d149089c0 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.042860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335981-1c3b-4173-bf28-3a1d149089c0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.042860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335981-1c3b-4173-bf28-3a1d149089c0 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.044235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 557/1118] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:27.049319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.049705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.049869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.068055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:27.069257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:27.133850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 562/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:27.405041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335981-1c3b-4173-bf28-3a1d149089c0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:27.502593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335981-1c3b-4173-bf28-3a1d149089c0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:27.520392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:27.535808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] PATH_INFO: `/v3/roles/040e823c6d874b98830778582091d28a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] RBAC: Authorizing `identity:get_role(role_id=040e823c6d874b98830778582091d28a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:27.541688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 558/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:27 2022] GET /identity/v3/roles/040e823c6d874b98830778582091d28a => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:27.547439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:27.608401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:27.645294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4997719-d65b-410d-8139-e1f5f82f2e52 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:27.678265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:27.678877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.679151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.679415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] PATH_INFO: `/v3/users/112353131cd04511b8ed8c224c98e3f4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.680575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=112353131cd04511b8ed8c224c98e3f4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:27.682632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:27.684238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 563/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:27 2022] GET /identity/v3/users/112353131cd04511b8ed8c224c98e3f4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:27.690145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:27.784940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65db4-4d7b-4ea1-999d-4bf9fe5d47d6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:27.817791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:27.818391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.818664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.818926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.820032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:27.821436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeea4f-ea2c-43fa-93d2-33f0c81c2438 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:27.823238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 559/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:27 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:27.829102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:27.925893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734dec5-f56e-4c86-92b8-cc17ff6cd1b3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:27.953521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:27.958299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:27.958941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:27.959219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:27.963379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428/users/112353131cd04511b8ed8c224c98e3f4/roles/040e823c6d874b98830778582091d28a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:27.963379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6560583ed884ee295c33da802f65428, user_id=112353131cd04511b8ed8c224c98e3f4, role_id=040e823c6d874b98830778582091d28a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:27.963676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7640e4-a7ba-496a-843b-df5aa6b73107 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:28.015503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 564/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:22:27 2022] PUT /identity/v3/projects/f6560583ed884ee295c33da802f65428/users/112353131cd04511b8ed8c224c98e3f4/roles/040e823c6d874b98830778582091d28a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:22:29.893073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717fbc-e7de-4aae-9186-81b3f3131a18 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:29.893622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717fbc-e7de-4aae-9186-81b3f3131a18 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:29.893622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717fbc-e7de-4aae-9186-81b3f3131a18 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:29.894931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 560/1124] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:29.900820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:29.901342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:29.901649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:29.919441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:29.920664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:29.986179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 565/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:30.259374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717fbc-e7de-4aae-9186-81b3f3131a18 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:30.315897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.360669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717fbc-e7de-4aae-9186-81b3f3131a18 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:30.393598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:30.394212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:30.394495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:30.394763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] PATH_INFO: `/v3/roles/040e823c6d874b98830778582091d28a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:30.396519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] RBAC: Authorizing `identity:get_role(role_id=040e823c6d874b98830778582091d28a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:30.397872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:30.399186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 561/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:30 2022] GET /identity/v3/roles/040e823c6d874b98830778582091d28a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:30.405236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:30.501228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e41de-d69b-43a7-8dc2-3f7e1abe2661 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:30.523215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.534235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:30.534845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:30.535119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:30.535389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] PATH_INFO: `/v3/users/112353131cd04511b8ed8c224c98e3f4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:30.536509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] RBAC: Authorizing `identity:get_user(user_id=112353131cd04511b8ed8c224c98e3f4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:30.537930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:30.539485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 566/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:30 2022] GET /identity/v3/users/112353131cd04511b8ed8c224c98e3f4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:30.545757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:30.642430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d02-cb29-49ac-9b72-e0efb837cd9d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:30.663343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.674989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:30.675627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:30.675937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:30.676206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:30.742119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:30.743554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:30.838319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 562/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:30.844375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:30.943325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088727e-09f2-4399-892b-6846f7ae926f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:30.976289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:30.976893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:30.977168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:30.977437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] PATH_INFO: `/v3/projects/f6560583ed884ee295c33da802f65428` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:30.978532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] RBAC: Authorizing `identity:get_project(project_id=f6560583ed884ee295c33da802f65428)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:30.979967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072972-ae50-4cb4-88e6-2a0c808150a9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:30.981568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 567/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:30 2022] GET /identity/v3/projects/f6560583ed884ee295c33da802f65428 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:30.987579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:31.011722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:31.084396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef311b0-8e33-40c0-99d0-8a2852663977 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:31.118395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:31.119475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:31.120000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:31.120320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:31.121039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] RBAC: Adding query filter params (role.id=040e823c6d874b98830778582091d28a, scope.project.id=f6560583ed884ee295c33da802f65428, user.id=112353131cd04511b8ed8c224c98e3f4) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:31.121347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:31.122765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866ef8-c5db-4db5-9a64-c08dd9f9fb66 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:31.128492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 563/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:30 2022] GET /identity/v3/role_assignments?user.id=112353131cd04511b8ed8c224c98e3f4&scope.project.id=f6560583ed884ee295c33da802f65428&role.id=040e823c6d874b98830778582091d28a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:33.045556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c167-9546-4dfc-97f2-cd8ffa65a5a1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:33.046085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c167-9546-4dfc-97f2-cd8ffa65a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:33.046085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c167-9546-4dfc-97f2-cd8ffa65a5a1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:33.047461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 568/1131] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:33.052610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:33.053024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:33.053160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:33.072084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:33.073372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:33.139108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 564/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:33.405322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735c167-9546-4dfc-97f2-cd8ffa65a5a1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:33.463858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:33.506384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735c167-9546-4dfc-97f2-cd8ffa65a5a1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:33.539345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:33.539987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:33.540266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:33.540537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:33.541729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:33.543149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31392368-bf0f-4ec3-8f88-f92fc69ee23f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:33.544741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 569/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:33.550678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:33.567873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:33.648730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07718-b786-4b3c-8875-df5ffb97f462 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:33.682865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:33.683458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:33.683739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:33.684043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:33.684682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:33.686102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320f3a0-64a0-4ec8-92ad-78309c8e998e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:33.776935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 565/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:22:33 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:35.710485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76502ded-b755-4462-9fbf-485870e4514a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:35.711037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76502ded-b755-4462-9fbf-485870e4514a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:35.711037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76502ded-b755-4462-9fbf-485870e4514a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:35.712373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 570/1135] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:35.717691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:35.718122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:35.718220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:35.736244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:35.737407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:35.797674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:35.802804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 566/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:36.076042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76502ded-b755-4462-9fbf-485870e4514a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:36.179055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76502ded-b755-4462-9fbf-485870e4514a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:36.205245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:36.214673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:36.215298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:36.215573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:36.215870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:36.216970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:36.218393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddfe31-e81a-470f-8f5f-2de3b93a7568 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:36.220155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 571/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:36.226268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:36.323712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0c5f6-7fd9-49ee-b05b-b57f665c3b29 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:36.357781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:36.358316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:36.358591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:36.358861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:36.359501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:36.360962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1deb-8f86-47d3-b15a-69544deb6c82 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:36.442285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 567/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:22:36 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:38.434484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695506dd-d56f-44c2-a0e5-60ad6c96a5c4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:38.434996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695506dd-d56f-44c2-a0e5-60ad6c96a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:38.435085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695506dd-d56f-44c2-a0e5-60ad6c96a5c4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:38.436398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 572/1139] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:38.441646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:38.442060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:38.442187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:38.460417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:38.461588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:38.510225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:38.526908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 568/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:38.796541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695506dd-d56f-44c2-a0e5-60ad6c96a5c4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:38.895103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695506dd-d56f-44c2-a0e5-60ad6c96a5c4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:38.927938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:38.928546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:38.928826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:38.929094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:38.939562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:38.944220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:38.945375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:38.946286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 573/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:38.951630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:39.047284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd82c1-9cb3-4bf1-acc2-e31ae6491445 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:39.080173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:39.080760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:39.081037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:39.081307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:39.081954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:39.082253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:39.083608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:39.091519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 569/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:39.097190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:39.152736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:39.197818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fb4b-eb71-4534-814a-b5917067a30f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:39.231325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:39.232079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:39.232357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:39.232627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] PATH_INFO: `/v3/users/2c52da0027264f169e002e3797dc019a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:39.245771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c52da0027264f169e002e3797dc019a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:39.247190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:39.248938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 574/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:39 2022] GET /identity/v3/users/2c52da0027264f169e002e3797dc019a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:39.254868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:39.302060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:39.358139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f712d3-13a7-4169-b80f-bf629543fc03 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:39.390919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:39.391518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:39.391818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:39.392095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:39.458569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:39.460025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:39.504374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:39.558226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 570/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:39.564195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:39.661882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d9c5b-64c6-4c23-a681-e21b6d88edc8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:39.675321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:39.695651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:39.696290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:39.696566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:39.696950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] PATH_INFO: `/v3/projects/1ee4187847754eb981daffe03af1bc2a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:39.698061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] RBAC: Authorizing `identity:get_project(project_id=1ee4187847754eb981daffe03af1bc2a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:39.699466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969da80-65d1-4f4f-9962-e8da395f17ec None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:39.701110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 575/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:39 2022] GET /identity/v3/projects/1ee4187847754eb981daffe03af1bc2a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:39.707245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:39.809496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c494-a259-4353-a9ea-82cb8707875d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:39.843048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:39.843645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:39.843952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:39.844221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:39.844937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=1ee4187847754eb981daffe03af1bc2a, user.id=2c52da0027264f169e002e3797dc019a) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:39.845238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:39.846659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14606a5c-2d9a-419e-96c6-8bb656d6c4a5 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:39.852151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 571/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:39 2022] GET /identity/v3/role_assignments?user.id=2c52da0027264f169e002e3797dc019a&scope.project.id=1ee4187847754eb981daffe03af1bc2a&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:22:41.751842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e115-2f93-44c2-bacb-51f8383d63c8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:41.752439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e115-2f93-44c2-bacb-51f8383d63c8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:41.752439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e115-2f93-44c2-bacb-51f8383d63c8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:41.753726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 576/1147] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:41.758912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:41.759846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:41.760018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:41.778319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:41.779488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:41.782215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:41.845587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 572/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:42.113530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e115-2f93-44c2-bacb-51f8383d63c8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:42.219053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1e115-2f93-44c2-bacb-51f8383d63c8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:42.257249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:42.257859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:42.258133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:42.258394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:42.268457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:42.273017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:42.274098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:42.275956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 577/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:42.280815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:42.378831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245171b-8c0d-4de4-83f2-0434cbacf3fc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:42.412618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:42.413232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:42.413506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:42.413772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:42.414419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:42.414716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:42.416768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:42.424594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 573/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:42.430423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:42.471875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:42.528564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2002-0194-4bdf-942d-f7828b11d175 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:42.560799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:42.561411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:42.561686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:42.561952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] PATH_INFO: `/v3/users/2c52da0027264f169e002e3797dc019a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:42.563059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] RBAC: Authorizing `identity:get_user(user_id=2c52da0027264f169e002e3797dc019a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:42.564497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:42.566055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 578/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:42 2022] GET /identity/v3/users/2c52da0027264f169e002e3797dc019a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:42.572413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:42.575252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:42.671077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c5f7-1644-4d6a-96a5-8602a34b0fc6 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:42.703620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:42.704268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:42.704546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:42.704816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] PATH_INFO: `/v3/projects/1ee4187847754eb981daffe03af1bc2a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:42.705923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] RBAC: Authorizing `identity:get_project(project_id=1ee4187847754eb981daffe03af1bc2a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:42.707346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dec2e-e0c6-4d74-8762-572b308e8a8b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:42.708983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 574/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:42 2022] GET /identity/v3/projects/1ee4187847754eb981daffe03af1bc2a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:42.715557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:42.811385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259da2a-dd12-4419-b2bd-a1d430510adb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:42.819799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:42.844521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:42.845159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:42.845437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:42.845708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] PATH_INFO: `/v3/projects/1ee4187847754eb981daffe03af1bc2a/users/2c52da0027264f169e002e3797dc019a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:42.847576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ee4187847754eb981daffe03af1bc2a, user_id=2c52da0027264f169e002e3797dc019a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:42.849282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592ba0-5926-4ad0-bbb2-d5adce6c99f5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:42.952418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 579/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:22:42 2022] PUT /identity/v3/projects/1ee4187847754eb981daffe03af1bc2a/users/2c52da0027264f169e002e3797dc019a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:22:44.839519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70e0d-35af-45ed-8ff6-f07795db3306 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:44.840122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70e0d-35af-45ed-8ff6-f07795db3306 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:44.840122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70e0d-35af-45ed-8ff6-f07795db3306 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:44.841423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 575/1154] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:44.846588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:44.846997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:44.847112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:44.864844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:44.865995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:44.930761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 580/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:45.197666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70e0d-35af-45ed-8ff6-f07795db3306 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:45.268161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:45.300204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70e0d-35af-45ed-8ff6-f07795db3306 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:45.337181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:45.338522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:45.338799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:45.339063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:45.351213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:45.361827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:45.363015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:45.364096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:45.364898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 576/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:45.369318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:45.472655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:45.476978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49667d-538a-43fb-8cee-1bef1be2a6c7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:45.517709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:45.518297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:45.518573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:45.518840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:45.519498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:45.519816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:45.521267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:45.531297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 581/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:45.537365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:45.657058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb623-d695-42c3-ba7c-045122e00fee None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:45.688297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:45.694014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:45.694643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:45.694918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:45.695185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] PATH_INFO: `/v3/users/2c52da0027264f169e002e3797dc019a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:45.696446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] RBAC: Authorizing `identity:get_user(user_id=2c52da0027264f169e002e3797dc019a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:45.698654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:45.700266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 577/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:45 2022] GET /identity/v3/users/2c52da0027264f169e002e3797dc019a => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:45.706352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:45.822849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52f6a-b282-4df1-97a9-83d99902cfd7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:45.858543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:45.859579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:45.860011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:45.860453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:45.893194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:45.937603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:45.939057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:46.046873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 582/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:46.052835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:46.151852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71e06-d548-4a87-a5a3-7454739e694a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:46.184943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:46.185553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:46.185828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:46.186095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] PATH_INFO: `/v3/projects/1ee4187847754eb981daffe03af1bc2a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:46.187196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] RBAC: Authorizing `identity:get_project(project_id=1ee4187847754eb981daffe03af1bc2a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:46.188654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe5aec-e75a-4e54-b2c9-7a1f4bbd3d76 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:46.190267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 578/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:22:46 2022] GET /identity/v3/projects/1ee4187847754eb981daffe03af1bc2a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:46.196410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:46.256671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:46.300418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec808cf5-5164-43c1-8990-0162e7f3109b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:46.336054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:46.336643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:46.336917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:46.337180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:46.337891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=1ee4187847754eb981daffe03af1bc2a, user.id=2c52da0027264f169e002e3797dc019a) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:46.338193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:46.339601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997877b5-9b2f-4e05-98dd-d353cb067ee0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:46.345284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 583/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:22:46 2022] GET /identity/v3/role_assignments?user.id=2c52da0027264f169e002e3797dc019a&scope.project.id=1ee4187847754eb981daffe03af1bc2a&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:48.276994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d2aeb-0e85-4f1a-9a73-6184e06fb4c4 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:48.277523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d2aeb-0e85-4f1a-9a73-6184e06fb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:48.277636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d2aeb-0e85-4f1a-9a73-6184e06fb4c4 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:48.278889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 579/1162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:48.284190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:48.284563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:48.284733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:48.302683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:48.303887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:48.368340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 584/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:48.637180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d2aeb-0e85-4f1a-9a73-6184e06fb4c4 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:48.702345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:48.737681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d2aeb-0e85-4f1a-9a73-6184e06fb4c4 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:48.770347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:48.770933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:48.771212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:48.771482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:48.836340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:48.837913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:48.900163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:48.934547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 580/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:48.940501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:48.993820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:49.037245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d5db4-9e76-4f46-a58d-f48045b08243 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:49.069396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:49.070007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:49.070282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:49.070550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:49.077074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:49.078485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-55afbd85-fe89-477e-ad0a-de7f682d678b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:49.090019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:49.091242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:22:49.092338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 585/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:22:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:49.097052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:49.191680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14332-dec3-4637-b748-e8f94182df2d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:49.224898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:49.225485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:49.225758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:49.226023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:49.226647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:49.226945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:49.228988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af1709-121b-4746-a39e-bd5bc798217f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:49.236014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 581/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 24 10:22:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:51.106755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fc2a-c800-428f-9ac8-f92312d34913 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:51.107285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fc2a-c800-428f-9ac8-f92312d34913 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:51.107285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fc2a-c800-428f-9ac8-f92312d34913 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:51.108682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 586/1167] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:51.113956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fad7-32bc-4352-bcf0-0736040b1785 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:51.114347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fad7-32bc-4352-bcf0-0736040b1785 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:51.114505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fad7-32bc-4352-bcf0-0736040b1785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:51.132728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5a54fad7-32bc-4352-bcf0-0736040b1785 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:51.133903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5a54fad7-32bc-4352-bcf0-0736040b1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:51.156940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:51.198668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 582/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:51.473458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8fc2a-c800-428f-9ac8-f92312d34913 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:51.574538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8fc2a-c800-428f-9ac8-f92312d34913 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:51.588763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:51.608722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:51.609318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:51.609592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:51.609855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:51.610512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:51.611895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336dbb-b1f4-4e28-ab34-20d6e4494f98 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:51.674116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 587/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Wed Aug 24 10:22:51 2022] POST /identity/v3/domains => generated 267 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:53.631464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378df2b-7ad8-451f-b0b3-2e9c306c1dea None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:53.631995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378df2b-7ad8-451f-b0b3-2e9c306c1dea None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:53.631995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378df2b-7ad8-451f-b0b3-2e9c306c1dea None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:53.633318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 583/1170] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:53.639326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:53.639734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:53.639914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:53.657809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:53.658989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:53.725207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 588/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:53.997103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378df2b-7ad8-451f-b0b3-2e9c306c1dea None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:54.096445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378df2b-7ad8-451f-b0b3-2e9c306c1dea None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:54.129615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:54.130224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:54.130499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:54.130764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] PATH_INFO: `/v3/domains/349ffd865bab44e0ae4f7866f7adf371` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:54.141549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=349ffd865bab44e0ae4f7866f7adf371)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:54.142978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7382f-e156-4157-917e-1d4367ee38e1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:54.144563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 584/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Aug 24 10:22:53 2022] GET /identity/v3/domains/349ffd865bab44e0ae4f7866f7adf371 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:54.150923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:54.246635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cb139-c71d-418e-b518-991bb74d29a1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:54.248961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:54.280020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:54.280621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:54.280899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:54.281170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:54.281806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:54.283232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2e425-6a64-4550-a860-ad71c8488b6b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:54.381938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 589/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:22:54 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:56.300600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cb2d-bfdb-4117-9434-76b1fe4180ea None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:56.301006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cb2d-bfdb-4117-9434-76b1fe4180ea None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:56.301154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cb2d-bfdb-4117-9434-76b1fe4180ea None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:56.302496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 585/1174] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:56.308496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:56.308943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:56.309043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:56.334374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:56.335549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:56.402016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 590/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:56.672263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1cb2d-bfdb-4117-9434-76b1fe4180ea None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:56.694794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:56.773203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1cb2d-bfdb-4117-9434-76b1fe4180ea None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:56.805452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:56.806726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:56.807165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:56.807435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] PATH_INFO: `/v3/domains/349ffd865bab44e0ae4f7866f7adf371` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:56.808556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=349ffd865bab44e0ae4f7866f7adf371)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:56.809966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c0973-d6a3-4686-9a72-98a4e2c819d6 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:56.811492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 586/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Aug 24 10:22:56 2022] GET /identity/v3/domains/349ffd865bab44e0ae4f7866f7adf371 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:56.817225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:56.898416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:56.912448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d4d0-d1ee-4e7d-9246-16439d013304 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:56.947236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:56.947759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:56.948065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:56.948422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:56.949187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:56.950609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0c6f-fb99-41df-8a9a-22407f720a5f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:57.036168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 591/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:22:56 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:22:58.980279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9a93-d443-45d0-ae6e-6a3d8777e345 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:58.980835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9a93-d443-45d0-ae6e-6a3d8777e345 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:58.980835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9a93-d443-45d0-ae6e-6a3d8777e345 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:58.982141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 587/1178] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:22:58.987259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:58.987699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:58.987821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:59.006144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:22:59.007324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:22:59.073382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 592/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:22:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:22:59.342669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc9a93-d443-45d0-ae6e-6a3d8777e345 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:59.430337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:59.442450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc9a93-d443-45d0-ae6e-6a3d8777e345 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:59.476796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:59.477402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:59.478346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:59.478615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:59.488298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:22:59.492885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:22:59.494159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:22:59.495100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 588/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:22:59.499989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:59.567461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:59.596133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5f0a-4ef4-464b-b594-9a59d338aa31 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:59.630381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:59.630965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:59.631236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:59.631497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:59.632174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:22:59.632470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:59.633833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:59.641883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 593/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:59.647654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:59.796087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4783-3f6f-4bab-bb7a-1329abdc25be None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:59.829496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:59.830050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:59.830325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:59.830593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] PATH_INFO: `/v3/users/e0caeea36c2c451b9931278378e8c6b3` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:59.843776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] RBAC: Authorizing `identity:get_user(user_id=e0caeea36c2c451b9931278378e8c6b3)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:22:59.845244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:22:59.846836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 589/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:22:59 2022] GET /identity/v3/users/e0caeea36c2c451b9931278378e8c6b3 => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:22:59.853037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:22:59.949662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dac0b-eb3f-4c5f-9c6a-e2535c87b180 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:22:59.982913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:22:59.983500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:22:59.983802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:22:59.984078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:22:59.986538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:00.049343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:00.050770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:00.144675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 594/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:22:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:23:00.150487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:00.159837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:00.248384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfa34-a783-46e7-87f0-1ccabbb0d275 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:00.280640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:00.281253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:00.281529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:00.281925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] PATH_INFO: `/v3/projects/e55f30665d3c4479859f78a5271d4210` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:00.283256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] RBAC: Authorizing `identity:get_project(project_id=e55f30665d3c4479859f78a5271d4210)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:00.284701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a791-9109-4962-a461-9f7f22951e39 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:00.286316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 590/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:23:00 2022] GET /identity/v3/projects/e55f30665d3c4479859f78a5271d4210 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:00.293109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:00.326113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:00.390054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf40fe6-c34a-4769-aaea-ebf36501e0e9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:00.425217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:00.426130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:00.426403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:00.426668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:00.427376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=e55f30665d3c4479859f78a5271d4210, user.id=e0caeea36c2c451b9931278378e8c6b3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:23:00.427674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:00.429111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82cd73-4c16-46a1-ac89-09dbdcf758ac None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:00.434248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 595/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:23:00 2022] GET /identity/v3/role_assignments?user.id=e0caeea36c2c451b9931278378e8c6b3&scope.project.id=e55f30665d3c4479859f78a5271d4210&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:02.303056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee75a-be6b-47e7-aed3-d2abf2383a6e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:02.303569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee75a-be6b-47e7-aed3-d2abf2383a6e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:02.303668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee75a-be6b-47e7-aed3-d2abf2383a6e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:02.304965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 591/1186] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:23:02.311446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:02.311939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:02.312111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:02.330128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:23:02.331338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:23:02.398285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 596/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:23:02.677705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee75a-be6b-47e7-aed3-d2abf2383a6e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:02.754363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:02.779152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee75a-be6b-47e7-aed3-d2abf2383a6e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:02.813578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:02.814183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:02.814459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:02.814726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:02.825184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:23:02.829785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:23:02.830912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:23:02.831838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 592/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:23:02.836859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:02.864019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:02.933481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832708d-32eb-4a17-aaf1-30e4ad4597f5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:02.965650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:02.966236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:02.966510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:02.966773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:02.967422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:23:02.967718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:02.969100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:02.977103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 597/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:02.983502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:03.080772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360c41-b3f0-40ce-a9aa-445f9285fa8e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:03.113746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:03.114379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:03.114814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:03.115237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] PATH_INFO: `/v3/users/e0caeea36c2c451b9931278378e8c6b3` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:03.116463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] RBAC: Authorizing `identity:get_user(user_id=e0caeea36c2c451b9931278378e8c6b3)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:03.117882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:03.119833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 593/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:23:02 2022] GET /identity/v3/users/e0caeea36c2c451b9931278378e8c6b3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:03.125368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:03.214084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:03.223693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9dd77-9a5f-47bc-a5a9-96a9ea6729c0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:03.257206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:03.257824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:03.258097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:03.258367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] PATH_INFO: `/v3/projects/e55f30665d3c4479859f78a5271d4210` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:03.259467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] RBAC: Authorizing `identity:get_project(project_id=e55f30665d3c4479859f78a5271d4210)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:03.261077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e59ee2-6683-411c-b942-adf471e8de24 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:03.262710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 598/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:23:03 2022] GET /identity/v3/projects/e55f30665d3c4479859f78a5271d4210 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:03.268656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:03.271449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:03.373534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74406ab-c5ac-4342-82b6-7d682e0e387f None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:03.406463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:03.407108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:03.407385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:03.407653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] PATH_INFO: `/v3/projects/e55f30665d3c4479859f78a5271d4210/users/e0caeea36c2c451b9931278378e8c6b3/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:03.409553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] RBAC: Authorizing `identity:create_grant(project_id=e55f30665d3c4479859f78a5271d4210, user_id=e0caeea36c2c451b9931278378e8c6b3, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:03.410978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fafc14-433e-432f-8edf-1482ce21a7fc None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:03.476083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 594/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:23:03 2022] PUT /identity/v3/projects/e55f30665d3c4479859f78a5271d4210/users/e0caeea36c2c451b9931278378e8c6b3/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:23:05.384756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da09-6a40-4c35-a6dd-f16e04a74443 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:05.385298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da09-6a40-4c35-a6dd-f16e04a74443 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:05.385298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da09-6a40-4c35-a6dd-f16e04a74443 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:05.386629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 599/1193] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:23:05.392004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:05.392439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:05.392531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:05.410483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:23:05.411639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:23:05.467011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:05.477459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 595/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:23:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:23:05.750359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da09-6a40-4c35-a6dd-f16e04a74443 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:05.860964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da09-6a40-4c35-a6dd-f16e04a74443 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:05.893845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:05.894455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:05.894735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:05.895005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:05.905571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:23:05.910285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:23:05.911398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:23:05.912461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 600/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:23:05.917457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:06.018434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb448f-70c2-4ae1-9e4c-b8184c69d716 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:06.053018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:06.053614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:06.053887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:06.054153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:06.054802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:23:06.055097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:06.056468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:06.064374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 596/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:06.070361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:06.090712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:06.171043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39997d-0628-4d6b-87fb-6a255bfcc3f8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:06.205504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:06.206119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:06.206395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:06.206664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] PATH_INFO: `/v3/users/e0caeea36c2c451b9931278378e8c6b3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:06.207765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=e0caeea36c2c451b9931278378e8c6b3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:06.209224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:06.210793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 601/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 24 10:23:06 2022] GET /identity/v3/users/e0caeea36c2c451b9931278378e8c6b3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:06.216865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:06.276222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:06.321079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda8e-f722-4e0a-82cd-cc78f8487aa8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:06.355718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:06.356382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:06.356656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:06.356921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:06.429584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:06.431015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:06.488405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:06.534233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 597/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:23:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:23:06.540098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:06.628024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:06.642997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694520-2a1d-49f4-8706-fe6d6d558bd0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:06.677773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:06.685084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:06.687970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:06.689735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] PATH_INFO: `/v3/projects/e55f30665d3c4479859f78a5271d4210` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:06.691155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] RBAC: Authorizing `identity:get_project(project_id=e55f30665d3c4479859f78a5271d4210)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:06.692874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2e665-b8e4-452e-9a0d-738e0a631c65 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:06.694497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 602/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 24 10:23:06 2022] GET /identity/v3/projects/e55f30665d3c4479859f78a5271d4210 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:06.700927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:23:06.805868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635db9-5cf6-4a8a-93ec-97d733a60012 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:23:06.841158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:23:06.841754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:23:06.842032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:23:06.842302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:23:06.843021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=e55f30665d3c4479859f78a5271d4210, user.id=e0caeea36c2c451b9931278378e8c6b3) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:23:06.843335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:23:06.845470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb996-c9b5-4abd-8e69-e4f1ddc65226 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:23:06.852883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 598/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:23:06 2022] GET /identity/v3/role_assignments?user.id=e0caeea36c2c451b9931278378e8c6b3&scope.project.id=e55f30665d3c4479859f78a5271d4210&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:23:16.672564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=23 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:16.850188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.301719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c4c8-df46-4cbe-944e-abf17c488c3d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.302208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c4c8-df46-4cbe-944e-abf17c488c3d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.302308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c4c8-df46-4cbe-944e-abf17c488c3d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.303592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 603/1201] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:25.309468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.309946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.310045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.327520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:25.328702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:25.396231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 599/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:25.662689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c4c8-df46-4cbe-944e-abf17c488c3d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.763547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c4c8-df46-4cbe-944e-abf17c488c3d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.797664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428fc-3427-4071-b87b-51445b056110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.798277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428fc-3427-4071-b87b-51445b056110 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.798551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428fc-3427-4071-b87b-51445b056110 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.798818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428fc-3427-4071-b87b-51445b056110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.808663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786428fc-3427-4071-b87b-51445b056110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:25.810094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786428fc-3427-4071-b87b-51445b056110 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-786428fc-3427-4071-b87b-51445b056110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:25.824154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:25.825369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:25.826384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:25.826384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:25.826384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:25.826384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 604/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:25.831360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:25.930302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023a7d2-838f-493f-975e-a928c25893a8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:25.958089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:25.964456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:25.965048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:25.965319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:25.965584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:25.966203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:25.966503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:25.967876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69808-3a6a-44cf-a14f-88c41ee3b099 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:25.978991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 600/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:25.984812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428fc-3427-4071-b87b-51445b056110 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:26.037334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:26.083010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428fc-3427-4071-b87b-51445b056110 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:26.116907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:26.122322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:26.122322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:26.122322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:26.122322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:26.122322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f3257-4c1a-4c7d-a4a2-fe905c1f60d5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:26.338504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 605/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 24 10:24:25 2022] POST /identity/v3/users => generated 251 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:28.282392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993cd3-0a3d-424e-b75d-96c2c6ab344f None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.282975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993cd3-0a3d-424e-b75d-96c2c6ab344f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.282975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993cd3-0a3d-424e-b75d-96c2c6ab344f None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.284459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 601/1206] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:28.290264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.290762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.290871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.309779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:28.310959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:28.378319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 606/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:28.647656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993cd3-0a3d-424e-b75d-96c2c6ab344f None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:28.751072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993cd3-0a3d-424e-b75d-96c2c6ab344f None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.785790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.786416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.786694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.786968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.797842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:28.803402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:28.804507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:28.805589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 602/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:28.810006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:28.849091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:28.908092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219a34-7cb2-4b74-b2d6-2f4f7982efb7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:28.942066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:28.942666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:28.942942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:28.943207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:28.943892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:28.944194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:28.945547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:28.953966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 607/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:28.960427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.011057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:29.060306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aaae6-2c19-49da-8035-a8a2e169498e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:29.092437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:29.093049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.093348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.093599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.104469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:29.109045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:29.121233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:29.122411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:29.123373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:29.123373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:29.123373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:29.123373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 603/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:29.128352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.234696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:29.237514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bca1-7b23-45a6-823a-5eedbcd1bba2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:29.270396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:29.270982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.271254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.271515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.272168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:29.272461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:29.273828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:29.285229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 608/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:29.291921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.393910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9d59-8992-4d67-910a-6fc888d9d842 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:29.395444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:29.429103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:29.429728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.430009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.430283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.437382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:29.438812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:29.450570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:29.452009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:29.453757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 604/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:29.460097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.560905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d1d4-1263-4138-8661-99197f33a7d3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:29.593967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:29.594573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.594853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.595122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.595873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:29.596179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:29.597848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:29.615434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 609/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:29.621586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.725064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636587a-d3c7-402f-b45b-65e2a62abf9c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:29.756905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:29.757505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:29.757784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:29.758055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:29.787526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:29.824318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:29.825701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:29.920237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 605/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:29.926229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:29.944970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.027665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6659f2-fb44-427a-9ed4-9f1d12246797 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.062180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.062794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.063070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.063337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.073729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.077127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:30.089716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:30.090882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:30.092031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:30.092031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:30.092031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:30.092031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 610/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:30.097035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.158527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.198905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a3ec-cb52-441d-a396-93083bd6e83a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.232855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.233445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.233716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.233979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.234599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:30.234892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.236290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.248184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 606/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:30.254067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.323494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.352800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2a94-0e3a-4ad6-bf44-5569b2fb6a75 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.386240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.386858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.387135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.387404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.393849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.395285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:30.406527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:30.407596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:30.408795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 611/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:24:30.413575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.514040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891b08-20d2-4184-81c6-0a29b8be88b3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.536252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.548289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.548886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.549166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.549426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.550099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:30.550394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.551931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9added1e-4f64-4b9d-b884-a7f2ae70467c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.563810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 607/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:30.569983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:30.671468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2883e-ce7f-4653-a8d6-98843953b60b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:30.699271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:30.704957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:30.705555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:30.705832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:30.706102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:30.706817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=34849cc7b860429287542bb4bd34a9e6) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:30.707131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:30.708662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7dae-1c1d-44ee-b884-48583da3e1c9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:30.713892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 612/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:30 2022] GET /identity/v3/role_assignments?user.id=34849cc7b860429287542bb4bd34a9e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:32.637096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169075a-aa70-4d03-addf-d5487a8aa0ab None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.637592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169075a-aa70-4d03-addf-d5487a8aa0ab None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.637592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169075a-aa70-4d03-addf-d5487a8aa0ab None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.638906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 608/1220] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:32.644357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:32.644753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:32.644916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:32.662657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:32.666905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:32.729672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 613/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:24:33.006880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169075a-aa70-4d03-addf-d5487a8aa0ab None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.109224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169075a-aa70-4d03-addf-d5487a8aa0ab None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.143344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.148637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.148637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.148637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.155006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:33.159643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:33.160855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:33.161766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 609/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:33.167065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.268097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c95b-6e02-4107-85ea-3635f3d51042 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.291364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.303494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.303494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.303494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.303494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.304019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:33.304328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.306544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.314848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 614/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.320577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.367179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.422683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af271b-fece-4086-809b-420d7e98eb69 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.457590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.458206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.458486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.458759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.468597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.472456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:33.485191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:33.486328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:33.487219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:33.487219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:33.487219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:33.487219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 610/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:33.492141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.589643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0feae7-a4b1-4c90-96b7-67e87542e227 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.623638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.624255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.624528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.624794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.625418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:33.625714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.627051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.638399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 615/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.644065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.736483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.743586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb650b80-a55a-4254-97fd-c9cb5bbd881e None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.776514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.777130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.777407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.777706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.784393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.785859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:33.798596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:33.799726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:33.801003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 611/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:33.806379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:33.854390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:33.907574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcdb7b-01ed-4aff-8335-bb52c70c5af8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:33.941846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:33.942440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:33.942762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:33.943100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:33.943867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:33.944212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:33.945705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:33.963683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 616/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:33.969424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.067131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737489cc-108f-47b2-8633-b35afd84f192 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.099696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.100327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.100597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.100859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.111671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.113067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:34.126773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:34.127721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:34.128689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:34.128689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:34.128689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:34.128689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 612/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:34.133868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.235328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae38712-7ab5-4812-9a4e-451c93567b75 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.237662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.268205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.271457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.271457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.271457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.271457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:34.271457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.271903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.283056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 617/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:34.288830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.298247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.386951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1aad7-076a-4e87-979a-dda52e035d95 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.420222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.420872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.421183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.421465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.428061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.429496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:34.440590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:34.441616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:34.442893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 613/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:34.448105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.546334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819ff92-0cc3-4c12-9e95-f14c477a5d2e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.579974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.580573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.580853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.581124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.581808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:34.582125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.583524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5f074-7b6c-457a-ae81-bb48a8833b1d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.596638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 618/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:34.602881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:34.669054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:34.704162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3fdfd-f9d5-4527-8b75-6487bea8ebaa None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:34.737546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:34.738192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:34.738477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:34.738744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/34849cc7b860429287542bb4bd34a9e6/roles/b3f30412f42a41b8b9ebddad713fe1ce` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:34.753351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=34849cc7b860429287542bb4bd34a9e6, role_id=b3f30412f42a41b8b9ebddad713fe1ce)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:34.754850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d188e-dcac-4439-ac51-1dff8b4026c3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:34.887886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 614/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:34 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/34849cc7b860429287542bb4bd34a9e6/roles/b3f30412f42a41b8b9ebddad713fe1ce => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:36.762242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f853-6cf1-41a5-ab5d-e69236410dd9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.762799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f853-6cf1-41a5-ab5d-e69236410dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.762799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f853-6cf1-41a5-ab5d-e69236410dd9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.764133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 619/1233] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:36.769323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:36.769713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:36.769870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:36.787526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:36.788767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:36.856809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 615/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:37.124331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551f853-6cf1-41a5-ab5d-e69236410dd9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.150095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.229541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551f853-6cf1-41a5-ab5d-e69236410dd9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.265765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.266378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.266650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.266911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.276696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:37.281429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:37.283051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:37.284557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 620/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:37.288862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.336260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.388508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98fb16-db81-4da0-8b93-0571800dd5d1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.421170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.421766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.422073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.422343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.423011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:37.423503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.425499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.433761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 616/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:37.439634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.524068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.539197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fea275-62ee-4d14-95e5-5306058fc582 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.572733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.573351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.573628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.573899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.584110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.593932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:37.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:37.603290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:37.604307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:37.604307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:37.604307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:37.604307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 621/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:37.608949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.708988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acba78-12f6-4eb6-a8ff-1e3e1facf5a8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.718797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.743947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.744544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.744825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.745095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.745729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:37.746029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.747400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.759566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 617/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:37.764871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:37.865659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f817-f6d9-4f87-b817-68ee3f0a7bbf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:37.898338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:37.899470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:37.899749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:37.900047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:37.902643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:37.907046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:37.908526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:37.920386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:37.926381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:37.927344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 622/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:37.927967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.027974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f06d-defd-4257-9559-530a0a1924df None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.061318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.061914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.062236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.062567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.063283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:38.063587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.065042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.082541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 618/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:38.089009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.189055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bea5f-d16f-4cc4-aeac-f043ccf4cd04 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.222424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.223071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.223351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.223619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.285878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.293072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.294520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.392763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 623/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:38.398670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.426796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.496430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a496-c77e-4ef0-bbfc-7e67940f701c None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.531363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.532013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.532290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.532557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.545829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.545829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:38.558636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:38.559774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:38.561122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:38.561122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:38.561122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:38.561122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 619/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:38.565547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.657806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.663309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462291e0-0119-43cc-93dc-93f29285d6fd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.696674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.697340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.697615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.697880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.698511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:38.698809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.700178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.711069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 624/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:38.717644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.798128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:38.818913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685b27-b700-4d6f-a686-95a6e94cac29 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:38.852981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:38.853645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:38.853920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:38.854185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:38.860621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:38.862043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:38.872858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:38.873974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:38.875071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 620/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:38.879808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:38.979601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a1edf-6764-4e77-ac2d-68b24bd408fb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.012803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.013392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.013670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.013933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.014603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:39.014901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.016363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625108d9-6a13-40a2-82f5-03a4a40377d8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.030341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 625/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:39.036450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:39.136564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd78d6-bba5-4028-aa51-b5c3afddfc26 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:39.169006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:39.169593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:39.169868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:39.170134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:39.170841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] RBAC: Adding query filter params (role.id=b3f30412f42a41b8b9ebddad713fe1ce, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=34849cc7b860429287542bb4bd34a9e6) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:39.171141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:39.172581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4123-f765-4bcc-b27b-31cb48b8cca4 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:39.178124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 621/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:39 2022] GET /identity/v3/role_assignments?user.id=34849cc7b860429287542bb4bd34a9e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=b3f30412f42a41b8b9ebddad713fe1ce => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:41.161037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4a47-74f0-4dc9-9ce5-1b6bb34f8097 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.161561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4a47-74f0-4dc9-9ce5-1b6bb34f8097 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.161561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4a47-74f0-4dc9-9ce5-1b6bb34f8097 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.162893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 626/1247] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:41.168762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.169151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.169312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.175692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.188270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:41.189451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:41.253906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 622/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:41.522645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4a47-74f0-4dc9-9ce5-1b6bb34f8097 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.541951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.622717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4a47-74f0-4dc9-9ce5-1b6bb34f8097 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.656194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.656820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.657092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.657360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.668047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:41.672662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:41.673731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:41.674607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 627/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:41.679733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.778503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c814152-4efa-4f8b-903a-b6a985c679d0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.808022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.812848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.813442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.813714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.813977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.814649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:41.814943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.816401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:41.824356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 623/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:41.830274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:41.906563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:41.929176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5b66-147e-4f83-b52e-086b9213adf7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:41.962767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:41.963383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:41.963681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:41.963981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:41.974157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:41.975653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:41.990495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:41.991626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:41.993327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:41.993327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:41.993327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:41.993327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 628/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:41.998331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.098087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b512c2-ed32-4b8e-a438-75b6f4a2e72b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.131065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.131700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.132003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.132271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.132898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:42.133198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.134550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.145983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 624/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.152612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.249691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f897be-5ba1-4002-b2d4-240c2c38b063 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.284347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.292693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751097-570d-4f51-8570-c64226bf437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.293371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751097-570d-4f51-8570-c64226bf437f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.293647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751097-570d-4f51-8570-c64226bf437f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.293914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751097-570d-4f51-8570-c64226bf437f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.301574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751097-570d-4f51-8570-c64226bf437f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.303038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751097-570d-4f51-8570-c64226bf437f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-40751097-570d-4f51-8570-c64226bf437f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:42.314229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:42.319617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:42.320709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 629/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:42.321470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.378845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.423027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6b2f-70bd-4cbd-b80c-f94f8ad5526a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.456048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.456644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.456922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.457229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.457943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:42.458243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.459657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.477433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 625/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:42.485165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751097-570d-4f51-8570-c64226bf437f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.585319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751097-570d-4f51-8570-c64226bf437f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.619278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.619907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.620192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.620461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.675107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.687153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.688628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.786925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 630/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:42.793510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:42.892544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630093-48f7-49fa-8eec-a3f5df82708a None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:42.905875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:42.926687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:42.927238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:42.927511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:42.927776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:42.937738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:42.939162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:42.953383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:42.954511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:42.955589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:42.955589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:42.955589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:42.955589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 626/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:42.960324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.046507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:43.058198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a14-e7db-4c7b-93de-84e3e1ce769f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.091944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.092835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.093171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.093664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.094654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:43.094956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.096614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.108204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 631/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:43.114140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.211367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e84b8-a2da-4982-8f12-843841e39ef8 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.244331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.244946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.245226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.245490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.251916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.253341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:43.264883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:43.265940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:43.266888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 627/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:43.271978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.374639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e2a39-3e7b-4771-9f15-d10221bf0fa6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.409198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.409829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.410078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.410348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.411062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:43.411364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.412823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782da35-259b-4e9c-a999-709be7c9400e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.425158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 632/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:43.431405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:43.457087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:43.530010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034190-3220-4778-8827-78f63b4ec5e1 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:43.562661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:43.563254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:43.563528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:43.563816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:43.564536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=34849cc7b860429287542bb4bd34a9e6) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:43.564840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:43.566311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7d675-d8f1-4018-aadd-832f1cbcc27e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:43.572378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 628/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:43 2022] GET /identity/v3/role_assignments?user.id=34849cc7b860429287542bb4bd34a9e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:45.477625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a200-2102-4c55-a6e7-53c526819dba None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.478194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a200-2102-4c55-a6e7-53c526819dba None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.478194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a200-2102-4c55-a6e7-53c526819dba None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.479464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 633/1261] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:45.484663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:45.485064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:45.485211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:45.503972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:45.505144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:45.575043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:24:45.861787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47a200-2102-4c55-a6e7-53c526819dba None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:45.873887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:45.975261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47a200-2102-4c55-a6e7-53c526819dba None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.016909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.017535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.017809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.018079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.029597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:46.034480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:46.035656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:46.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 634/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:46.042599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.070443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.160804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2f20-ac6a-43da-8786-87514e462c51 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.197383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.197991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.198269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.198592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.199259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:46.199562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.201370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.210602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 630/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.217400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.291102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.335931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936cee5-4b61-4f0e-9f89-a72e24f9bf33 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.378089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.378804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.379086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.379357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.392207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.393649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:46.410626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:46.413211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:46.414386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:46.414386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:46.414386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:46.414386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 635/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:46.419351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.503309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.524551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb94b1-c5ef-4f13-90d5-3d6b42edb489 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.559706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.560334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.560606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.560869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.561490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:46.561784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.563126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.574282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 631/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:46.580209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.682821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafbe6-1c11-4fce-857f-3432d845004d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.702002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.716216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.716833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.717108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.717376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.724874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.726286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:46.737654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:46.738870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:46.740051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 636/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:46.745250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:46.844589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cfa71-5a7a-4476-9403-4934208df590 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:46.877592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:46.878195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:46.878469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:46.878732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:46.879449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:46.879748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:46.881194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:46.890124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:46.897997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 632/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:46.904225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.002328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbad-4249-47fe-8776-c7aa8bb35208 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.036587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.037203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.037480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.037749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.048681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.050661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:47.064000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:47.065123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:47.066254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:47.066254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:47.066254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:47.066254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 637/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:47.071754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.174296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa6b7-9abc-4def-91a1-f400f5954f7d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.208310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.208901 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.209180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.209454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.210080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:47.210379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.212650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.223832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 633/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:47.230028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.261807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.331090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567248-4627-4f79-9fc8-871d050041b7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.365956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.366575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.366855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.367122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.374310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.375736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:47.387403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:47.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:47.389625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 638/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:47.394662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.454227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.497938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c308-3948-4907-8504-c623c972d3b2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.530886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.531466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.531686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.531976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.532655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:47.532955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.534372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbaa6-4484-47bd-a319-cc899fd0c291 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.546205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 634/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:47.552317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:47.644171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:47.652461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9348-21c0-4c34-b433-77a3102ffdb3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:47.684743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:47.685439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:47.685662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:47.685925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] PATH_INFO: `/v3/projects/2150d48507b9449a9c373a323d24f29b/users/34849cc7b860429287542bb4bd34a9e6/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:47.687772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] RBAC: Authorizing `identity:create_grant(project_id=2150d48507b9449a9c373a323d24f29b, user_id=34849cc7b860429287542bb4bd34a9e6, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:47.689201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092005b8-ee27-48e3-9257-75204e723f5c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:47.849349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 639/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 24 10:24:47 2022] PUT /identity/v3/projects/2150d48507b9449a9c373a323d24f29b/users/34849cc7b860429287542bb4bd34a9e6/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:24:49.808653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f124-13d5-492d-a305-82452eae251b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.809199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f124-13d5-492d-a305-82452eae251b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.809199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f124-13d5-492d-a305-82452eae251b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.810546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 635/1274] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:49.815860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:49.816254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:49.816414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:49.834407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:49.835592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:49.902955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 640/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:50.182873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f124-13d5-492d-a305-82452eae251b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.283252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f124-13d5-492d-a305-82452eae251b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.300617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.317255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.321541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.321541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.321541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.330867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:24:50.335451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:50.336688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:50.338496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 636/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:50.343257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.426275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.447728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eaa89-4fcd-49e1-8d9d-af60cabdeed0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.483236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.483931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.484236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.484533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.485214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:50.485533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.486964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.496031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 641/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:50.501861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.602535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ed5f-3d19-4160-8a79-ca6c14b929fc None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.636310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.636927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.637203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.637470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.647209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.648701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:50.662617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:50.663760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:50.665044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:50.665044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:50.665044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:50.665044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 637/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:50.669880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.771141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644885a-3c75-4d10-b01b-962652f3e073 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.804501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.805672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.805953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.806217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.806851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:50.807151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.808613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.820092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 642/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:50.826186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.858100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:50.928058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820666-3f91-4626-a8b0-5dc3bfc0b6a2 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:50.961938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:50.962552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:50.962830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:50.963099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:50.970124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:50.971863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:24:50.984836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:50.985941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:50.987331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 638/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:50.991973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:50.996604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.103399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bdb-d941-4d86-b6d8-a44d5cdc2141 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.136289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.136882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.137159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.137428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.138136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:51.138436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.139915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.158327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 643/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 24 10:24:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:24:51.165179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.256024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.265716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27497ae-6bfc-4edc-834b-ab20b53c4700 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.301955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.302558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.302838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.303109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.371943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.373421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.460967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.471736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 639/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:24:51.478156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.539157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.576523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056c08-62f8-4404-87f4-27b2b22782af None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.608835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.609447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.609723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.609991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.620381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.621859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:24:51.635883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:51.637023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:24:51.638289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:24:51.638289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:24:51.638289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:51.638289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 644/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:51.642669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.742390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58f072-08d3-4982-a951-04dff20f776d None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.777407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.778008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.778285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.778554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.779188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:51.779488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.780983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.793030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 640/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:51.798802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:51.903672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a1b78-1d67-4f8a-ae0d-bdadb390693f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:51.916690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:51.936387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:51.937011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:51.937288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:51.937560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:51.944070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:51.945514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:24:51.957042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:51.958138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 24 10:24:51.959281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 645/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:51.964165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.015852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:52.064721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39fac-0b97-45a2-9f99-052782afe241 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.099690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52629447-7187-417e-a986-206e3d142db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.100321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629447-7187-417e-a986-206e3d142db2 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.100613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629447-7187-417e-a986-206e3d142db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.100930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629447-7187-417e-a986-206e3d142db2 None admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.101645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52629447-7187-417e-a986-206e3d142db2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:52.102165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52629447-7187-417e-a986-206e3d142db2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.103839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52629447-7187-417e-a986-206e3d142db2 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.115619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 641/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 24 10:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:52.122583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:52.231404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e6318-5af6-482d-ae23-facaa9a4c5f0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:52.271399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:52.272231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:52.272608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:52.272922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:52.273831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] RBAC: Adding query filter params (role.id=bbb06ed9c58640e3bc1ad8aad3773c29, scope.project.id=2150d48507b9449a9c373a323d24f29b, user.id=34849cc7b860429287542bb4bd34a9e6) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:52.274269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:52.276150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd772-77c2-4dae-851f-864d827f1cff None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:52.283470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 646/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 24 10:24:52 2022] GET /identity/v3/role_assignments?user.id=34849cc7b860429287542bb4bd34a9e6&scope.project.id=2150d48507b9449a9c373a323d24f29b&role.id=bbb06ed9c58640e3bc1ad8aad3773c29 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.235242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131a8d-72af-4e47-9e03-8470b865af5d None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.235832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131a8d-72af-4e47-9e03-8470b865af5d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.235832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131a8d-72af-4e47-9e03-8470b865af5d None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.237229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 642/1288] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:54.242374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.242802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.243044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.260953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:54.262999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:54.292526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.329013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 647/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:24:54.602866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6131a8d-72af-4e47-9e03-8470b865af5d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.707605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6131a8d-72af-4e47-9e03-8470b865af5d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.718605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:54.744251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.744878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.745155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.745423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.745994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.747505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:24:54.756196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:24:54.758037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:24:54.759465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 643/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:24:54.763862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:54.868857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aeee1-eeb7-4e2c-bc15-929152ad9040 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:54.911583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:54.912206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:54.912476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:54.912741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:54.913353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:54.913650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:54.915629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0e15a-b6eb-4f91-8c29-24625d527544 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:54.920507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 648/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:54.926408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:55.025755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c286234-fbeb-451a-af5c-8fb98296adf3 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:55.060371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:55.060979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:55.063026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:55.063026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] PATH_INFO: `/v3/services` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:55.063026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:24:55.063026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:55.063848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a444-f261-413e-9a39-aeb48bc4d2d8 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:55.068386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 644/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 24 10:24:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:24:56.983864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856183-33b4-436a-b90f-44a1a1a8f42c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.984388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856183-33b4-436a-b90f-44a1a1a8f42c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.984388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856183-33b4-436a-b90f-44a1a1a8f42c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:56.985750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 649/1293] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:56.991013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f996be-a3ab-4a8f-a69d-d207c5c95bd2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:56.991432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f996be-a3ab-4a8f-a69d-d207c5c95bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:56.991612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f996be-a3ab-4a8f-a69d-d207c5c95bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.009881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-55f996be-a3ab-4a8f-a69d-d207c5c95bd2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:57.011041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-55f996be-a3ab-4a8f-a69d-d207c5c95bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:57.038898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.075008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 645/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:24:57.343508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856183-33b4-436a-b90f-44a1a1a8f42c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:57.375542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:57.447134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856183-33b4-436a-b90f-44a1a1a8f42c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:24:57.484571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:24:57.485172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:57.485456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:57.485815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:57.486458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:24:57.487832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467109b8-1c0e-4cca-9743-136ee01e8462 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:24:57.577544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 650/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 24 10:24:57 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:24:59.517542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418ddf-3896-47d1-8d2f-9b602fcfcc36 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.518096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418ddf-3896-47d1-8d2f-9b602fcfcc36 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.518096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418ddf-3896-47d1-8d2f-9b602fcfcc36 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.519490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 646/1296] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:24:59.525508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:24:59.525931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:24:59.526030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:24:59.544775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:24:59.545950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:24:59.617323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 651/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:24:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:24:59.882514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418ddf-3896-47d1-8d2f-9b602fcfcc36 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:24:59.983089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418ddf-3896-47d1-8d2f-9b602fcfcc36 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.016018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.016625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.016897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.017160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.017731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.019075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:00.028026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:00.029281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:00.030279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 647/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:24:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:00.035199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.052948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.133497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4319e-d5d2-405e-92db-a7a2da27fbd9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.166716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.167302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.167577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.167869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.168486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:00.168893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.170275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.175189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 652/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:00.181295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.213879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.283250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647beb-9030-4a93-9e3b-8fe0ea5c1e38 None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.318429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.319038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.319315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.319583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.320319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] RBAC: Adding query filter params (interface=public, service_id=7fcbf8d3b8c3470891481b80b310e15a, region_id=RegionOne) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:00.320631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.322187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a00f-d065-4c18-969e-14e9ae42406e None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.327148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 648/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/endpoints?service_id=7fcbf8d3b8c3470891481b80b310e15a&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:00.333089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:00.416721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:00.434090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2cdce-3c33-4c61-8877-68736c6d0ae8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:00.470167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:00.470792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:00.471335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:00.471630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:00.472244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:00.473624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7578c-a7c3-4b66-b66c-37dc90f51860 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:00.480586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 653/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 24 10:25:00 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:25:02.473664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de57f-da1d-4e05-90fc-f50667307ff6 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:02.474204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de57f-da1d-4e05-90fc-f50667307ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:02.474204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de57f-da1d-4e05-90fc-f50667307ff6 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:02.475498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 649/1302] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:25:02.481590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:02.485732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:02.485732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:02.500598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:25:02.501766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:25:02.567904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 654/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:25:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:25:02.837240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de57f-da1d-4e05-90fc-f50667307ff6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:02.933144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:02.939674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de57f-da1d-4e05-90fc-f50667307ff6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:02.974333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:02.974951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:02.975230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:02.975501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:02.976122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:02.978342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:25:02.986831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:25:02.990125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application with Lock( Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: ERROR keystone.server.flask.application Aug 24 10:25:02.991196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 650/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 24 10:25:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:25:02.994906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:03.068462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:03.090735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3d43-a0d4-498e-aa2d-2458af151d59 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:03.126221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:03.126839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.127116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.127397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.128064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:25:03.128364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:03.129767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9933c-88f4-46f5-81f9-e4a9abb8f887 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:03.135050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 655/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 24 10:25:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:25:03.140899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:25:03.241495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30cef-15a9-486e-8b74-f5850cec8f7b None admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:25:03.274828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:25:03.275415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:25:03.275692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:25:03.275990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:25:03.276631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:25:03.277990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17814e-acbe-408c-bff8-3034e3ef187c None admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:25:03.374092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 651/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:25:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:25:13.131794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=30 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:13.368051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:00.633653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fc3b-ca64-4ca9-9e7a-9570d89b968e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:00.634672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fc3b-ca64-4ca9-9e7a-9570d89b968e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:00.635170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fc3b-ca64-4ca9-9e7a-9570d89b968e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:00.642182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dbf8c-b52a-4abc-bc18-3ceb8bef27ce None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:00.643075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dbf8c-b52a-4abc-bc18-3ceb8bef27ce None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:00.643556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dbf8c-b52a-4abc-bc18-3ceb8bef27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:00.648725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 656/1307] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:00.723399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0a4dbf8c-b52a-4abc-bc18-3ceb8bef27ce None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:00.724972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0a4dbf8c-b52a-4abc-bc18-3ceb8bef27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:00.903861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 652/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:32:01.183330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.184036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.184368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.185963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 657/1309] 10.222.0.50 () {54 vars in 965 bytes} [Wed Aug 24 10:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:01.195411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9682f-ca17-4778-9f6b-5a5cf78179db None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.195752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9682f-ca17-4778-9f6b-5a5cf78179db None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.196040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9682f-ca17-4778-9f6b-5a5cf78179db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.284027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4fb9682f-ca17-4778-9f6b-5a5cf78179db None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:01.285309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4fb9682f-ca17-4778-9f6b-5a5cf78179db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:01.316549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.383227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 653/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Aug 24 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:32:01.393536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.395430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:01.517578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd439d1-1e13-454d-9e92-8bee569b88c0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.599168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.599771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.600188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.600460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.602098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:01.661957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.722777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:01.724250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91549a5-a8e9-448a-9337-61b2f42c1cc6 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:01.744199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 658/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:03.959725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:03.960259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:03.960259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:03.961825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 654/1312] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:03.968796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d47-5cff-4b72-8915-829a2b543efe None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:03.969643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d47-5cff-4b72-8915-829a2b543efe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:03.969921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d47-5cff-4b72-8915-829a2b543efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.056558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e32b5d47-5cff-4b72-8915-829a2b543efe None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:04.058192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e32b5d47-5cff-4b72-8915-829a2b543efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:04.164213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 659/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:04.451462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.453074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:04.555591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15e8f3-aa65-4e9a-a0d1-f7b81885f5c0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.636814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.639165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.639768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.640067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.640333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.641933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:04.754143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:04.755607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a9c7-29ce-4a11-8f11-f19923127553 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:04.775839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 655/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:07.227220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692862-4a15-4dac-a801-75d29e488ea4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:07.227757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692862-4a15-4dac-a801-75d29e488ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:07.227757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692862-4a15-4dac-a801-75d29e488ea4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:07.229124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 660/1315] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:07.234272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5911-1447-4c56-a38d-ca24a1d7d414 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:07.234652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5911-1447-4c56-a38d-ca24a1d7d414 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:07.234811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa5911-1447-4c56-a38d-ca24a1d7d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:07.309909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2cfa5911-1447-4c56-a38d-ca24a1d7d414 None None] MFA Rules not processed for user `46d6f6c7d946446f809757021f629631`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:07.312039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2cfa5911-1447-4c56-a38d-ca24a1d7d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:07.372072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:07.422250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 656/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:07.744216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:07.744486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:07.744766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:07.747092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 661/1317] 10.222.0.50 () {54 vars in 965 bytes} [Wed Aug 24 10:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:07.753095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818351e-e3bc-4322-b4ff-7b8217d66b6e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:07.758154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818351e-e3bc-4322-b4ff-7b8217d66b6e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:07.758154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818351e-e3bc-4322-b4ff-7b8217d66b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:07.828753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0818351e-e3bc-4322-b4ff-7b8217d66b6e None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:07.830229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0818351e-e3bc-4322-b4ff-7b8217d66b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:07.905609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 657/1318] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Aug 24 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:07.914514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:07.916059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:07.925666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:08.017461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72cb0e-42d9-433f-bc36-19dec3dae471 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:08.090369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:08.090976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:08.091252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:08.091520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:08.093147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:08.153618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:08.199683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:08.201146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1adbe-64ee-47ae-9ffd-6871be029fc2 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:08.219598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 662/1319] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:11.296868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:11.297432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:11.297432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:11.298737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 658/1320] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:11.304208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66321-8d86-460a-ba71-970d68f5d267 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:11.304612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66321-8d86-460a-ba71-970d68f5d267 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:11.304832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66321-8d86-460a-ba71-970d68f5d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:11.372494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-01c66321-8d86-460a-ba71-970d68f5d267 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:11.373734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-01c66321-8d86-460a-ba71-970d68f5d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:11.470148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 663/1321] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:11.756063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:11.757600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:11.807035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:11.860996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1625e-1418-45b4-9bde-9c9065bc722a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:11.931798 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:11.932975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:11.933261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:11.933526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:11.935106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:12.028967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:12.041444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:12.042940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e001-e512-41eb-af92-3dd53dd1fe78 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:12.061619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 659/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:14.920575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:14.921129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:14.921129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:14.922629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 664/1323] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:14.927649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883109-515c-48ef-855f-5762881f8584 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:14.928084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883109-515c-48ef-855f-5762881f8584 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:14.928264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883109-515c-48ef-855f-5762881f8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:14.997308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ea883109-515c-48ef-855f-5762881f8584 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:14.998647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ea883109-515c-48ef-855f-5762881f8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:15.096329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 660/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:15.386930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:15.388689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:15.408923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:15.500555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352af54-9306-42ad-97dd-c150b7ff8c9c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:15.575417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:15.576051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:15.576330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:15.576599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:15.578188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:15.650160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:15.687701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:15.689327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f9645-df52-4964-985b-eb2afdd3163b service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:15.708583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 665/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:17.711394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:17.711973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:17.711973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:17.713311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 661/1326] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:17.719675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51944-d1de-4978-ae35-d51ea65ff15c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:17.720160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51944-d1de-4978-ae35-d51ea65ff15c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:17.720270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51944-d1de-4978-ae35-d51ea65ff15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:17.786367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-03d51944-d1de-4978-ae35-d51ea65ff15c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:17.787494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-03d51944-d1de-4978-ae35-d51ea65ff15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:17.887916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 666/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:18.170627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:18.172197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:18.237079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:18.281172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20f59-ee40-4d2a-8956-48c3adc519ae None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:18.361523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:18.362157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:18.362438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:18.362710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:18.364344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:18.483344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:18.485847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:18.487335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fab67a-fe84-4e8b-9269-00b7b94099b9 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:18.506516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 662/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:20.483043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:20.483641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:20.483641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:20.484947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 667/1329] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:20.490697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7adc4-1b7b-41df-b312-2a8ecf44756e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:20.491180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7adc4-1b7b-41df-b312-2a8ecf44756e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:20.491325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7adc4-1b7b-41df-b312-2a8ecf44756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:20.562242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-31f7adc4-1b7b-41df-b312-2a8ecf44756e None None] MFA Rules not processed for user `46d6f6c7d946446f809757021f629631`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:20.563474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-31f7adc4-1b7b-41df-b312-2a8ecf44756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:20.680444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 663/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:32:20.968658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:20.970207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:21.131129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:21.205791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa910b-d28f-4d49-a5b3-bda52531a49e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:21.278866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:21.279387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:21.279663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:21.279973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:21.281550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:21.360076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:21.392133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:21.393563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1eeb7-cba0-4e08-85e8-f231109ddad9 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:21.411733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 668/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:23.749876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:23.750439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:23.750439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:23.751771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 664/1332] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:23.757008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aba43-4f76-494d-924d-4afc5254a3f2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:23.757442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aba43-4f76-494d-924d-4afc5254a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:23.757545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aba43-4f76-494d-924d-4afc5254a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:23.825367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a47aba43-4f76-494d-924d-4afc5254a3f2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:23.826570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a47aba43-4f76-494d-924d-4afc5254a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:23.922218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 669/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:24.200573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:24.202125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:24.273161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:24.308708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de64206-4c1d-4f4e-b952-c9de9aedd591 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:24.381545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:24.382072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:24.382357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:24.382625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:24.384235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:24.490738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:24.492206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9950f6-7e06-4a96-8cf5-d88279b9009b service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:24.502494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:24.510755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 665/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:26.448672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:26.449215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:26.449215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:26.450538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 670/1335] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:26.455924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2d8a-9782-41d9-8d29-43126481f1b5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:26.456336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2d8a-9782-41d9-8d29-43126481f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:26.456475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2d8a-9782-41d9-8d29-43126481f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:26.520869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f83c2d8a-9782-41d9-8d29-43126481f1b5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:26.522047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f83c2d8a-9782-41d9-8d29-43126481f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:26.617264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 666/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:26.904147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:26.905681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:26.946735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:27.009176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7dbb0-c3c1-41fd-93af-40574183ee6d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:27.081777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:27.082378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:27.082656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:27.082925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:27.084550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:27.166149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:27.192735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:27.194166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be947ef-2c87-4681-92a6-9b360e8f29c3 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:27.212917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 671/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:29.660913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:29.661482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:29.661482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:29.662687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 667/1338] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:29.668040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb9a0-490e-47f6-836e-73f9b493e2ef None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:29.668478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb9a0-490e-47f6-836e-73f9b493e2ef None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:29.668574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb9a0-490e-47f6-836e-73f9b493e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:29.734342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0fcdb9a0-490e-47f6-836e-73f9b493e2ef None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:29.735549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0fcdb9a0-490e-47f6-836e-73f9b493e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:29.831368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 672/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:30.118740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:30.121009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:30.194963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:30.222018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f281-5c78-405a-9ece-e0bd36acdfcb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:30.294011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:30.294691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:30.294963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:30.295231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:30.296927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:30.404731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:30.406222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5849-3825-4bc1-9843-850869cd0ab2 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:30.424839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 668/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:34.534333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:34.534889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:34.534889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:34.536245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 673/1341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:34.541639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2ec9-a01c-4df6-bf04-c9aec843310b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:34.542108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2ec9-a01c-4df6-bf04-c9aec843310b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:34.542200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2ec9-a01c-4df6-bf04-c9aec843310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:34.547920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:34.610563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-21eb2ec9-a01c-4df6-bf04-c9aec843310b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:34.611830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-21eb2ec9-a01c-4df6-bf04-c9aec843310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:34.715434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 669/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:35.001612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:35.003131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:35.053516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:35.110852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42c43-bbc7-4ecc-be28-9e7e272da8fc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:35.186287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:35.186890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:35.187174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:35.187440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:35.189059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:35.285355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:35.313674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:35.313674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6b92-f556-4b11-b9ba-01e73e5706f2 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:35.324817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 674/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:38.406254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:38.406861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:38.406861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:38.408253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 670/1344] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:38.413446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20dee-4678-4331-815d-c51cfeba2084 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:38.413877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20dee-4678-4331-815d-c51cfeba2084 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:38.413976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20dee-4678-4331-815d-c51cfeba2084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:38.480492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f5d20dee-4678-4331-815d-c51cfeba2084 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:38.481688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f5d20dee-4678-4331-815d-c51cfeba2084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:38.576765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 675/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:38.862958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:38.864504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:38.954571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:38.974953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706bc49-8d77-4dbe-9699-b047d3928645 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:39.047774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:39.048406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:39.048686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:39.048956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:39.050555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:39.164122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:39.165569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48048de-3157-4f68-ba5d-8be67c8fdcd4 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:39.183923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 671/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:43.715878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:43.716417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:43.716533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:43.717858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 676/1347] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:43.723456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adb8a-20c0-4ffa-b27a-098ba1e7e4fb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:43.723912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adb8a-20c0-4ffa-b27a-098ba1e7e4fb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:43.724041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7adb8a-20c0-4ffa-b27a-098ba1e7e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:43.740731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:43.795206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2b7adb8a-20c0-4ffa-b27a-098ba1e7e4fb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:43.797545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2b7adb8a-20c0-4ffa-b27a-098ba1e7e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:43.899698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 672/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:44.189551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:44.191121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:44.254805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:44.302112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8bed8-7bad-4bb6-b6a0-ca27be7e8b14 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:44.376760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:44.377361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:44.377672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:44.377940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:44.379521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:44.486883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:44.490435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:44.491986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee0bda-99fd-4ff8-b239-0b768464b22b service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:44.512317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 677/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:32:49.432265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2514a-a431-4071-8e48-2a12b00654d8 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:49.432751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2514a-a431-4071-8e48-2a12b00654d8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:49.432835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2514a-a431-4071-8e48-2a12b00654d8 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:49.434474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 673/1350] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:49.439479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab241-8759-4da9-9be0-6ab2e87ad75e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:49.439870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab241-8759-4da9-9be0-6ab2e87ad75e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:49.440078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab241-8759-4da9-9be0-6ab2e87ad75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:49.548217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5aeab241-8759-4da9-9be0-6ab2e87ad75e None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:49.549945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5aeab241-8759-4da9-9be0-6ab2e87ad75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:49.715985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 678/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:53.897868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=59 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:54.007299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35933855-130e-485c-93ec-4fb9f3a5b7d3 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:54.007956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35933855-130e-485c-93ec-4fb9f3a5b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:54.008399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35933855-130e-485c-93ec-4fb9f3a5b7d3 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:54.009740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 674/1352] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:54.014999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf58fa-1b81-4627-b086-4e56c67ae042 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:54.015471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf58fa-1b81-4627-b086-4e56c67ae042 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:54.015618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf58fa-1b81-4627-b086-4e56c67ae042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:54.073301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:54.097329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5bcf58fa-1b81-4627-b086-4e56c67ae042 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:54.098654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5bcf58fa-1b81-4627-b086-4e56c67ae042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:54.214083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 679/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:55.562255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef893b3-37b2-4e7c-be2c-f53ca24c0265 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:55.562775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef893b3-37b2-4e7c-be2c-f53ca24c0265 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:55.562775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef893b3-37b2-4e7c-be2c-f53ca24c0265 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:55.564084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 675/1354] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:55.569370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f86f2-b30e-48c5-b13f-635af6b1e2e7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:55.569761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f86f2-b30e-48c5-b13f-635af6b1e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:55.570034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f86f2-b30e-48c5-b13f-635af6b1e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:55.647747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1c9f86f2-b30e-48c5-b13f-635af6b1e2e7 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:55.648976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1c9f86f2-b30e-48c5-b13f-635af6b1e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:55.691115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:55.755993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 680/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:32:59.088970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9ff7-e495-4b36-a691-f427e3fdcc04 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:59.089510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9ff7-e495-4b36-a691-f427e3fdcc04 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:59.089510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9ff7-e495-4b36-a691-f427e3fdcc04 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:59.090929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 676/1356] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:59.096318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96b769-54e1-4348-a925-9a00b818fcce None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:59.096740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96b769-54e1-4348-a925-9a00b818fcce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:59.097025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96b769-54e1-4348-a925-9a00b818fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:59.171155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0f96b769-54e1-4348-a925-9a00b818fcce None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:59.172405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0f96b769-54e1-4348-a925-9a00b818fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:59.310240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 681/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:32:59.610198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:59.610480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:59.610911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:59.612702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 677/1358] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 24 10:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:59.621976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de574-44e9-4fc1-ae08-f25be9716800 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:59.622801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de574-44e9-4fc1-ae08-f25be9716800 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:59.623430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de574-44e9-4fc1-ae08-f25be9716800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:59.642970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:59.706972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-142de574-44e9-4fc1-ae08-f25be9716800 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:59.708200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-142de574-44e9-4fc1-ae08-f25be9716800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:59.828633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 682/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 24 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:32:59.836892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:59.838991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:00.003951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d87e4-dd89-47ee-96cf-5d473f747873 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:00.080447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:00.122521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:00.123120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:00.123570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:00.123879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:00.125456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:00.221869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:00.223523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b73a-63e2-44c7-8fb9-ff0e036a117d service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:00.243024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 678/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:33:02.394283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:02.394913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:02.394913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:02.396385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 683/1361] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:02.402215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb512-d397-485e-99cb-1d4498e2dced None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:02.402709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb512-d397-485e-99cb-1d4498e2dced None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:02.402821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb512-d397-485e-99cb-1d4498e2dced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:02.471024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3b5cb512-d397-485e-99cb-1d4498e2dced None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:02.472251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3b5cb512-d397-485e-99cb-1d4498e2dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:02.511149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:02.587193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 679/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:02.891366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:02.892978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:02.964624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:03.084535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd948e1-6226-4e3e-ac4b-b89b8d49a358 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:03.219569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:03.220205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:03.220496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:03.220766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:03.222486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:03.250474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:03.332037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:03.333897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69211d-5cd0-4aed-b84d-1b420f8e8754 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:03.353973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 684/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:05.828061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a98b8-f5ba-4af2-86d5-d077c1112757 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:05.828628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a98b8-f5ba-4af2-86d5-d077c1112757 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:05.828628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a98b8-f5ba-4af2-86d5-d077c1112757 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:05.830257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 680/1364] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:05.835523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d61f66-6458-4216-833d-7212fe8167bd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:05.835997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d61f66-6458-4216-833d-7212fe8167bd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:05.836176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d61f66-6458-4216-833d-7212fe8167bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:05.905625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f4d61f66-6458-4216-833d-7212fe8167bd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:05.906830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f4d61f66-6458-4216-833d-7212fe8167bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:06.030937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:06.034030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 685/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:06.329943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.330231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.330702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.332293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 681/1366] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 24 10:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:06.338177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34516-975e-4d9c-9a45-06db2d358117 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.338755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34516-975e-4d9c-9a45-06db2d358117 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.339034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34516-975e-4d9c-9a45-06db2d358117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.423218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-42c34516-975e-4d9c-9a45-06db2d358117 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:06.424471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-42c34516-975e-4d9c-9a45-06db2d358117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:06.553985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 686/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 24 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:06.563858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:06.565573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:06.844498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a0c19-3789-44a4-8792-950bc4ac270e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:06.870161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:06.969494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:06.970098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.970534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.970811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.972410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:07.065313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:07.066926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51f5e-8d80-4674-8aa0-f795677cfeb1 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:07.085633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 682/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:07.413679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f75b-e5a2-4752-9e6d-4be4a9678f0a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.414234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f75b-e5a2-4752-9e6d-4be4a9678f0a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.414234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f75b-e5a2-4752-9e6d-4be4a9678f0a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.416312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 687/1369] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:07.422139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee9f0-f48a-4158-8cee-82a4b97b1143 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.422399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee9f0-f48a-4158-8cee-82a4b97b1143 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.422672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee9f0-f48a-4158-8cee-82a4b97b1143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.458041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:07.504670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-10cee9f0-f48a-4158-8cee-82a4b97b1143 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:07.505862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-10cee9f0-f48a-4158-8cee-82a4b97b1143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:07.609433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 683/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:08.226141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.226787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.227266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.229827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 688/1371] 10.222.0.50 () {54 vars in 964 bytes} [Wed Aug 24 10:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:08.235205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73a73a-0931-4968-83ff-058312ecfaa6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.235648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73a73a-0931-4968-83ff-058312ecfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.235758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73a73a-0931-4968-83ff-058312ecfaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.326326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7d73a73a-0931-4968-83ff-058312ecfaa6 None None] MFA Rules not processed for user `efa91470f945469798d16d84fbe4f35d`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:08.327818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7d73a73a-0931-4968-83ff-058312ecfaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:08.380496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.410357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 684/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Aug 24 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:08.418769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:08.420374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:08.475981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.534718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400a14-a929-4a1d-ace1-4980f8697ff4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:08.615098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:08.615794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.616082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.616353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.618000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:08.722208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.738070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:08.739745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bc41d-8551-4e1a-be4f-60c32773b38a service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:08.760244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 689/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:09.288168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:09.288861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:09.288861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:09.290825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 685/1374] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:33:09.296272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cd83-71c3-47ad-b6c9-8e92fc50ff9b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:09.296557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cd83-71c3-47ad-b6c9-8e92fc50ff9b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:09.296831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cd83-71c3-47ad-b6c9-8e92fc50ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:09.364909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-85d0cd83-71c3-47ad-b6c9-8e92fc50ff9b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:09.366107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-85d0cd83-71c3-47ad-b6c9-8e92fc50ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:09.466582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 690/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:09.762240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:09.763811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:09.908880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a906e-badd-436a-b72c-2f99afdc8470 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:09.961136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:10.024195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:10.025351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:10.025640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:10.025939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:10.027706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:10.121460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:10.123281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad5f7-151c-4710-9fb0-49452632febb service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:10.142126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 686/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:12.214659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.215204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.215204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.216727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 691/1377] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:12.222127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79a55-47ad-4d23-93ab-a625c5e16834 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.222527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79a55-47ad-4d23-93ab-a625c5e16834 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.222804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79a55-47ad-4d23-93ab-a625c5e16834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.300815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e2d79a55-47ad-4d23-93ab-a625c5e16834 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:12.301686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e2d79a55-47ad-4d23-93ab-a625c5e16834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:12.310811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:12.419818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 687/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:12.710244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.712179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:12.781347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:12.871412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34c8a5-f2ef-4832-b55c-235fce0a1153 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.990286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.990794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.991064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.991328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.992928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:13.013275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:13.087983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:13.089914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd056e57-0878-4601-9476-389496f371b9 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:13.109312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 692/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:15.188071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.188627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.188627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.190818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 688/1380] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:15.195334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b46f4-8351-4019-bd7d-2a274bafa8a3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.195754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b46f4-8351-4019-bd7d-2a274bafa8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.196000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b46f4-8351-4019-bd7d-2a274bafa8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.267885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-627b46f4-8351-4019-bd7d-2a274bafa8a3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:15.269467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-627b46f4-8351-4019-bd7d-2a274bafa8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:15.389299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:15.411826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 693/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:15.699768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:15.701402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:15.845276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:15.856423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc814c-0d81-4a33-8dd5-1e11d71d78dc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:15.974177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:15.974774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.975044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.975310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.976910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:16.077138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.078750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdafe2-092b-4218-8aee-56ce4f699e92 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.091264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:16.099765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 689/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:18.229246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:18.229848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:18.229848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:18.231116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 694/1383] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:18.236667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541913-3c58-4759-80ee-d1630e9b10c6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:18.237150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541913-3c58-4759-80ee-d1630e9b10c6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:18.237150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541913-3c58-4759-80ee-d1630e9b10c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:18.305662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5c541913-3c58-4759-80ee-d1630e9b10c6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:18.306930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5c541913-3c58-4759-80ee-d1630e9b10c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:18.411982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 690/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:18.702348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:18.704463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:18.866568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2453dd-b869-43ff-81fe-e119c8820fcd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:18.942209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:18.991121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:18.991705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:18.992006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:18.992268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:18.993962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:19.086731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:19.088888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261eb45-0435-4138-b266-20d8d796978f service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:19.108412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 695/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:21.090489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.090999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.090999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.092343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 691/1386] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:21.097883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365052-1a21-4db2-a474-58197337a0fe None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.098383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365052-1a21-4db2-a474-58197337a0fe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.098546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365052-1a21-4db2-a474-58197337a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.168143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f9365052-1a21-4db2-a474-58197337a0fe None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:21.169369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f9365052-1a21-4db2-a474-58197337a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:21.205871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.281218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 696/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:21.586344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:21.588705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:21.667625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.739530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42121b1-8cc1-4a47-9223-a284061bac62 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.859744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.860440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.860794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.861337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.863417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:21.904928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.956763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.958369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0beea-4a17-4af1-bdee-4363a6b274c3 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.977023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 692/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:24.020896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.021469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.021469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.022769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 697/1389] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:24.028466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ec80-7892-40b1-bfbd-84a116ea7add None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.028895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ec80-7892-40b1-bfbd-84a116ea7add None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.029007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ec80-7892-40b1-bfbd-84a116ea7add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.093880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8f18ec80-7892-40b1-bfbd-84a116ea7add None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:24.095066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8f18ec80-7892-40b1-bfbd-84a116ea7add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:24.199476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 693/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:24.494601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:24.496240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:24.708840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645a5d-bcb4-4111-9e86-fa3a96e3a4b1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cee14-5b47-4ee8-98c0-a51381bf5175 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cee14-5b47-4ee8-98c0-a51381bf5175 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cee14-5b47-4ee8-98c0-a51381bf5175 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 694/1391] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8146f-0788-49d9-a4a4-9719702328c2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.709160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8146f-0788-49d9-a4a4-9719702328c2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.709612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8146f-0788-49d9-a4a4-9719702328c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.709692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:24.709776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:24.738037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-57a8146f-0788-49d9-a4a4-9719702328c2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:24.739172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-57a8146f-0788-49d9-a4a4-9719702328c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:24.777893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:24.778523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.778814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.779121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.780822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:24.836814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 695/1392] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:24.873167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:24.874756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8614-eff4-405d-a41f-ad1273656aac service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:24.893581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 698/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:25.142058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.142629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.142629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.144013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 696/1394] 10.222.0.50 () {54 vars in 967 bytes} [Wed Aug 24 10:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:25.149432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfebe44-02d4-402c-a1b6-e5db617bb303 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.150012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfebe44-02d4-402c-a1b6-e5db617bb303 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.150012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfebe44-02d4-402c-a1b6-e5db617bb303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.177330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.234821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fcfebe44-02d4-402c-a1b6-e5db617bb303 None None] MFA Rules not processed for user `6b0a6b75badb4d04a7d32044d2d61af2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:25.236008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fcfebe44-02d4-402c-a1b6-e5db617bb303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:25.313701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 699/1395] 10.222.0.50 () {58 vars in 1064 bytes} [Wed Aug 24 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:25.321199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.322972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:25.425224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.432549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424bd6-20b4-48d0-9133-19f5b4d39d19 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.508792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.510263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.510538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.510809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.512603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:25.623584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.625050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028ea6a-f40d-4c54-ac46-271eec29fac8 service glance] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.643118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 697/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:26.571206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3bcc-59a2-4225-906a-9ec0b6d92468 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.572273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3bcc-59a2-4225-906a-9ec0b6d92468 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.572428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3bcc-59a2-4225-906a-9ec0b6d92468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.641250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-709f3bcc-59a2-4225-906a-9ec0b6d92468 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:26.642451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-709f3bcc-59a2-4225-906a-9ec0b6d92468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:26.706465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:26.736484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 700/1397] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:26.783856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.784371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.784458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.785916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 698/1398] 10.222.0.50 () {54 vars in 943 bytes} [Wed Aug 24 10:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:26.792404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40ff94-7c8e-455f-bfcc-66760063aaa1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.792889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40ff94-7c8e-455f-bfcc-66760063aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.793232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40ff94-7c8e-455f-bfcc-66760063aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.877324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dc40ff94-7c8e-455f-bfcc-66760063aaa1 None None] MFA Rules not processed for user `21315db813dc407d8b0577065110be44`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:26.878565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dc40ff94-7c8e-455f-bfcc-66760063aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:26.985586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 701/1399] 10.222.0.50 () {58 vars in 1040 bytes} [Wed Aug 24 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:26.995219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.996803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:27.009959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692365a-7fb2-4adc-bbe5-c79f087d63ab None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:27.010468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692365a-7fb2-4adc-bbe5-c79f087d63ab None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:27.010817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692365a-7fb2-4adc-bbe5-c79f087d63ab None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:27.012392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 702/1400] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:33:27.017125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:27.017391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:27.017667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:27.021339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:27.063589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:27.086008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:27.087398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:27.139075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ff7f5-49e3-4247-b968-8e44fe86da62 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:27.186690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 703/1401] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:33:27.242203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:27.242807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:27.243088 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:27.243354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:27.246083 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:27.253365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:27.333076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:27.334691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e17ef-170a-458a-8ddf-506b9fc13024 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:27.343121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 699/1402] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:33:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:33:27.481345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:27.482594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:27.597762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4744-8d80-4d90-957c-7d814f680c8c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:27.601380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:27.717622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:27.718174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:27.718449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:27.718715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:27.720395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:27.826829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:27.828485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319223-e2d1-4fec-a82f-fc3fa9da5d21 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:27.849216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 704/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:29.985958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.986998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.987479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.991820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 700/1404] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:29.995085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47246b-6585-41d3-b8d7-6bc7fe685670 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.995640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47246b-6585-41d3-b8d7-6bc7fe685670 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.995640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47246b-6585-41d3-b8d7-6bc7fe685670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.010644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.076416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ca47246b-6585-41d3-b8d7-6bc7fe685670 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:30.078221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ca47246b-6585-41d3-b8d7-6bc7fe685670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:30.215607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 705/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:30.547178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.571748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:30.740373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f6aa7-8094-4ed7-9486-04bd3206dd75 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.754338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.898554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.899134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.899409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.900365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.902236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:31.006358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:31.021591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccfa92-9ae8-4b53-92db-c10aaf7e31b0 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:31.028085 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 701/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:33.501846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:33.504537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:33.504908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:33.506398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 706/1407] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:33:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:33.512751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b702-f484-44ad-88a6-61e6562fc4be None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:33.513246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b702-f484-44ad-88a6-61e6562fc4be None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:33.513332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b702-f484-44ad-88a6-61e6562fc4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:33.522864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.585678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0189b702-f484-44ad-88a6-61e6562fc4be None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:33.586936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0189b702-f484-44ad-88a6-61e6562fc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:33.700773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 702/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:33.986346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:33.987873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:34.084605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:34.154392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f75c13-5886-4140-a4fc-2bc0bbf09fe9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:34.281789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:34.282437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:34.282720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:34.282998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:34.284634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:34.358736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:34.406497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:34.408175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b566b-95ca-4dc0-8312-91edc0756dd8 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:34.427516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 707/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:43.698553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=62 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:44.425264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=23 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:51.525421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329e75-532d-4390-beb2-15f224b56682 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:51.525956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329e75-532d-4390-beb2-15f224b56682 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:51.525956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329e75-532d-4390-beb2-15f224b56682 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:51.527314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 703/1410] 10.222.0.50 () {54 vars in 918 bytes} [Wed Aug 24 10:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:51.532796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828f5-ed65-4359-8f9e-741a842991ff None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:51.533220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828f5-ed65-4359-8f9e-741a842991ff None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:51.533330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828f5-ed65-4359-8f9e-741a842991ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:51.610398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-14e828f5-ed65-4359-8f9e-741a842991ff None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:51.611538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14e828f5-ed65-4359-8f9e-741a842991ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:51.721059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 708/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 24 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:51.735859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d338f-ca73-4ed3-b97b-d36f61deeab2 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:51.736142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d338f-ca73-4ed3-b97b-d36f61deeab2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:51.736414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d338f-ca73-4ed3-b97b-d36f61deeab2 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:51.737749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 704/1412] 10.222.0.50 () {54 vars in 918 bytes} [Wed Aug 24 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:51.742318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c15-995d-4163-8574-7114ed28171a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:51.742600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c15-995d-4163-8574-7114ed28171a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:51.742877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c15-995d-4163-8574-7114ed28171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:51.814744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:51.817271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eae14c15-995d-4163-8574-7114ed28171a None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:51.818486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eae14c15-995d-4163-8574-7114ed28171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:51.934393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 709/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 24 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:54.384853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:54.385524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:54.385524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:54.386733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:54.392083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200637-8715-42a2-bac2-95e3cbe108f9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:54.392489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200637-8715-42a2-bac2-95e3cbe108f9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:54.392661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200637-8715-42a2-bac2-95e3cbe108f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:54.459129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-81200637-8715-42a2-bac2-95e3cbe108f9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:54.460368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-81200637-8715-42a2-bac2-95e3cbe108f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:54.516731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:54.558735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:54.851635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:54.853631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:54.998893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f9f49-b817-4779-b1a1-e5a668021f1b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:55.069824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:55.110863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:55.111388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:55.112182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:55.112460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:55.114043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:55.200515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:55.202090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203c185-271a-46d9-b6b1-7b568c3f85a7 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:55.220218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 706/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:56.110354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:56.110867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:56.110867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:56.112260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:56.117030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456fa-0c96-4a5f-bdfd-feb9296d2372 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:56.117455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456fa-0c96-4a5f-bdfd-feb9296d2372 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:56.117576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456fa-0c96-4a5f-bdfd-feb9296d2372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:56.194182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-eee456fa-0c96-4a5f-bdfd-feb9296d2372 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:56.195363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-eee456fa-0c96-4a5f-bdfd-feb9296d2372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:56.221653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:56.291816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:56.441735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:56.443240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:56.589703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9badaf9-f4dc-4b32-8007-b37a37456f17 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:56.637186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:56.713423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:56.713950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:56.714227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:56.714495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:56.716128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:56.807590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:56.809296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122638f3-857f-4791-903e-b2481ff1cefb service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:56.828769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 712/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:57.715739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:57.716347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:57.716347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:57.717657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:57.722499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b7ab-820e-468f-bbc5-35a7bbd9a151 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:57.722929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b7ab-820e-468f-bbc5-35a7bbd9a151 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:57.723039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b7ab-820e-468f-bbc5-35a7bbd9a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:57.776667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:57.798498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d291b7ab-820e-468f-bbc5-35a7bbd9a151 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:57.799696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d291b7ab-820e-468f-bbc5-35a7bbd9a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:57.894659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:58.048755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:58.050186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:58.194031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2127dfe-b548-4650-a174-827cb711ed14 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:58.206226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:58.313847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:58.314448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:58.314725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:58.314995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:58.316618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:58.406393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:58.408011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1532b0-76d9-4970-b247-ef056415870e service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:58.425700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 709/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:33:59.290785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:59.291347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:59.291347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:59.292777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:59.297777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd57a-fd99-410d-983e-c71b9653143b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:59.298214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd57a-fd99-410d-983e-c71b9653143b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:59.298308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd57a-fd99-410d-983e-c71b9653143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:59.317486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:59.375275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-562cd57a-fd99-410d-983e-c71b9653143b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:59.376531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-562cd57a-fd99-410d-983e-c71b9653143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:59.472419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:33:59.626333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:59.627883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:59.742188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:59.778845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ff40-b8e5-4f79-a127-ce5f78d766b9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:59.892789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:59.893396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:59.893675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:59.893944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:59.895535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:59.972837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:59.987139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:59.988818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111cff-01e7-4a67-8afd-3d6929fc9613 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:00.008171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 715/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:00.875426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:00.876003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:00.876003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:00.877384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:34:00.882479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afee-78cf-47e9-830a-858d01e0de5f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:00.883300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afee-78cf-47e9-830a-858d01e0de5f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:00.883300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afee-78cf-47e9-830a-858d01e0de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:00.958028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c838afee-78cf-47e9-830a-858d01e0de5f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:00.959233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c838afee-78cf-47e9-830a-858d01e0de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:01.058074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:01.211278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:01.213772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:01.300193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:01.362075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc078952-bf82-4c44-aa12-e3ad066df044 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:01.477872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:01.478503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:01.478786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:01.479060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:01.480712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:01.529688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:01.570298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:01.573008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49818b38-df55-42de-8b8c-bcc782b12e4b service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:01.592323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 712/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:02.469261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:02.469697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:02.469813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:02.471154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:34:02.476178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b30c-8865-44b2-985e-85407dd2e304 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:02.491129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b30c-8865-44b2-985e-85407dd2e304 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:02.491129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b30c-8865-44b2-985e-85407dd2e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:02.553987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ada3b30c-8865-44b2-985e-85407dd2e304 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:02.555692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ada3b30c-8865-44b2-985e-85407dd2e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:02.654694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:02.822317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:02.823776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:02.872167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:02.968688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab81d7c-709b-4202-9072-c21e88582c9f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:03.080488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:03.081005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:03.081279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:03.081540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:03.083113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:03.090581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:03.173234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:03.174807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05e070-5950-4b1e-9ece-aa2b88e8dc70 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:03.192889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 718/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:04.076025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:04.076563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:04.076563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:04.077908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:04.082758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae576-e87e-40c9-af85-791c7c348f71 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:04.083199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae576-e87e-40c9-af85-791c7c348f71 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:04.083307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae576-e87e-40c9-af85-791c7c348f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:04.159712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4bdae576-e87e-40c9-af85-791c7c348f71 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:04.160947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4bdae576-e87e-40c9-af85-791c7c348f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:04.229057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:04.257399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:04.409009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:04.410530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:04.428358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:04.559452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925bd9-6492-49d6-8383-3f6f9f342a7e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:04.645399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:04.671376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:04.671987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:04.672265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:04.672567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:04.674200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:04.764995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:04.766578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edee9-3aec-4d73-a4bd-331c50427459 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:04.784587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 715/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:05.682079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:05.682644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:05.682644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:05.683975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:05.688931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b78d2-d848-44e8-951c-01dad92a45ec None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:05.689364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b78d2-d848-44e8-951c-01dad92a45ec None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:05.689644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b78d2-d848-44e8-951c-01dad92a45ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:05.764742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4a0b78d2-d848-44e8-951c-01dad92a45ec None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:05.765925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4a0b78d2-d848-44e8-951c-01dad92a45ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:05.807348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:05.863717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:06.014129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:06.015590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:06.159681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef0e7d-1282-402f-8085-d27e4d176884 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:06.215756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:06.275075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:06.275593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:06.275891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:06.276165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:06.277742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:06.366740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:06.368422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ba0e-f535-4498-9aa3-c156041250c1 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:06.386312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 721/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:07.268603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:07.269182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:07.269182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:07.270512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:07.276066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ebde-b6cd-427a-943e-5f06f645f447 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:07.276498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ebde-b6cd-427a-943e-5f06f645f447 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:07.276605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ebde-b6cd-427a-943e-5f06f645f447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:07.353573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1ac3ebde-b6cd-427a-943e-5f06f645f447 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:07.354779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ac3ebde-b6cd-427a-943e-5f06f645f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:07.356830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:07.452030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:07.605468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:07.606954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:07.753571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd7b58-2e21-4ff6-8f41-db9e5da06ce7 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:07.780264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:07.868117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:07.868620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:07.868896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:07.869166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:07.870792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:07.958951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:07.960575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef798fd-66f6-42f3-8d56-6e25341b13d5 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:07.979721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 718/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:09.805795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:09.806362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:09.806362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:09.807695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:09.813192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87b42-8e3a-46b1-bb9c-b70e360e74a7 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:09.813629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87b42-8e3a-46b1-bb9c-b70e360e74a7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:09.813745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df87b42-8e3a-46b1-bb9c-b70e360e74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:09.854110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:09.878998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3df87b42-8e3a-46b1-bb9c-b70e360e74a7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:09.880219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3df87b42-8e3a-46b1-bb9c-b70e360e74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:09.980268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:10.282867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:10.284414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:10.388833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db67fa-770e-476a-b8a8-f393b9e73889 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:10.421139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:10.463680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:10.464328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:10.464944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:10.465219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:10.466824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:10.575927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:10.577501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd19e-9f63-494d-95f7-9bd774bf3f26 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:10.596490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 724/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:12.690941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:12.691486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:12.691486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:12.692864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:12.698750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9a83c-0b51-4bd3-b4c0-04d5cd4fad72 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:12.699252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9a83c-0b51-4bd3-b4c0-04d5cd4fad72 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:12.699396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9a83c-0b51-4bd3-b4c0-04d5cd4fad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:12.764012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8ab9a83c-0b51-4bd3-b4c0-04d5cd4fad72 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:12.765206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8ab9a83c-0b51-4bd3-b4c0-04d5cd4fad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:12.778272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:12.862742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:13.144893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:13.146425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:13.249704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50f57-75c6-4e99-ab36-4ef534c9f811 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:13.261492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:13.323891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:13.324668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:13.325044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:13.325404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:13.327185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:13.434223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:13.435652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7c4f9-63dd-4f92-ad54-5b73b6b05b50 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:13.454354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 721/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:15.734947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:15.735545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:15.735655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:15.736995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:15.742308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ba6b7-4dea-4539-be46-035a09869731 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:15.742890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ba6b7-4dea-4539-be46-035a09869731 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:15.743080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ba6b7-4dea-4539-be46-035a09869731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:15.792534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:15.809983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2d9ba6b7-4dea-4539-be46-035a09869731 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:15.811213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2d9ba6b7-4dea-4539-be46-035a09869731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:15.909836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:16.195310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:16.197101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:16.301106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae46a-0dbb-4ca2-a60e-4d7f34e7e7c2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:16.342521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:16.375728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:16.376583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:16.376924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:16.377366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:16.379260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:16.488388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:16.489885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c2e69-2279-42f8-9aa2-38a88317eb6e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:16.509234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 727/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:18.578906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:18.579467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:18.579467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:18.580849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:18.586902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c495ad-300c-4096-b41f-a8da6273fe5e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:18.587604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c495ad-300c-4096-b41f-a8da6273fe5e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:18.587702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c495ad-300c-4096-b41f-a8da6273fe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:18.653045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e2c495ad-300c-4096-b41f-a8da6273fe5e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:18.654255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e2c495ad-300c-4096-b41f-a8da6273fe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:18.674526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:18.749891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:19.038245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:19.039837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:19.142630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454a9f6-785c-4c3f-8ec3-3402ee2e7c7b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:19.162296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:19.218160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:19.218763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:19.219040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:19.219309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:19.221069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:19.331558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:19.333036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8d03-e6da-4978-8274-a554794befff service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:19.352251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 724/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:21.320170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:21.320741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:21.320859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:21.322222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:21.327730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51997e-2942-4160-87eb-94fd7f3d1aa6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:21.328209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51997e-2942-4160-87eb-94fd7f3d1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:21.328343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51997e-2942-4160-87eb-94fd7f3d1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:21.391844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:21.394862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1d51997e-2942-4160-87eb-94fd7f3d1aa6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:21.396101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1d51997e-2942-4160-87eb-94fd7f3d1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:21.494175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:21.782276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:21.783850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:21.886913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe90ff-356c-437d-b046-757cab4a7d46 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:21.936033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:21.960059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:21.960659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:21.965124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:21.965124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:21.965124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:22.071206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:22.072580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e2a9a-a4e0-4a1d-ba2f-aebd69777740 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:22.092599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 730/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:24.040522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:24.041096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:24.041096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:24.042419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:24.047765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d152bf-f6d3-46e9-8944-c96253f2c3b6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:24.048210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d152bf-f6d3-46e9-8944-c96253f2c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:24.048318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d152bf-f6d3-46e9-8944-c96253f2c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:24.113317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-14d152bf-f6d3-46e9-8944-c96253f2c3b6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:24.114505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14d152bf-f6d3-46e9-8944-c96253f2c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:24.143562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:24.209976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:24.499869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:24.501450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:24.604857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5018-e4cc-4c59-a5b2-93c712a00ce4 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:24.632633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:24.677392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:24.677987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:24.678257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:24.678517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:24.680697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:24.785851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:24.787285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762d876-03b6-405b-8033-1567abb9f735 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:24.806210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 727/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:26.764234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:26.764776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:26.764776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:26.766161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:26.771358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad9d2-3bea-4fc5-ba09-0b306e7ef59b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:26.771772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad9d2-3bea-4fc5-ba09-0b306e7ef59b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:26.771959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad9d2-3bea-4fc5-ba09-0b306e7ef59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:26.838140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ecbad9d2-3bea-4fc5-ba09-0b306e7ef59b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:26.839337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ecbad9d2-3bea-4fc5-ba09-0b306e7ef59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:26.847520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:26.937672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:27.223410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:27.225018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:27.329903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b838d65-a40d-41c9-bbb8-615d46f32104 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:27.385170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:27.404532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:27.405147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:27.405523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:27.405802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:27.407417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:27.518089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:27.519518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412ae9a-dc75-4220-9a60-39e5eb3f8697 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:27.539020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 733/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:29.524694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:29.525297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:29.525297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:29.526767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:29.532315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101227a9-08b5-4d81-8338-9200e8fbbce3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:29.532755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101227a9-08b5-4d81-8338-9200e8fbbce3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:29.532855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101227a9-08b5-4d81-8338-9200e8fbbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:29.599080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-101227a9-08b5-4d81-8338-9200e8fbbce3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:29.600230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-101227a9-08b5-4d81-8338-9200e8fbbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:29.639397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:29.698516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:29.983436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:29.985003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:30.091088 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de4da9-69ea-4e60-95b7-dc4e1aff6275 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:30.128917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:30.165644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:30.166268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:30.167214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:30.167214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:30.168541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:30.275308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:30.276703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021fdc6-8ab0-4d13-8c78-c63925df241c service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:30.295235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 730/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:34:32.261755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:32.262300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:32.262300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:32.263686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:32.269119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ba1-9bf8-448e-9054-1cafb1871920 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:32.269548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ba1-9bf8-448e-9054-1cafb1871920 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:32.269653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ba1-9bf8-448e-9054-1cafb1871920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:32.336857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-301c4ba1-9bf8-448e-9054-1cafb1871920 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:32.338311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-301c4ba1-9bf8-448e-9054-1cafb1871920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:32.356519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:32.435842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:32.716716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:32.718243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:32.821910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9abc4-04b9-4d8d-af1e-5959e5e9bb88 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:32.887634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:32.894385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:32.896723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:32.896723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:32.896723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:32.897100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:33.006228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:33.009014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498965f0-d98d-41e4-8aba-fb03fb85e05e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:33.027517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 736/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:34.946171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:34.946800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:34.946800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:34.948135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:34.953379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47db-280c-4436-92f1-83cc69a546f8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:34.953798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47db-280c-4436-92f1-83cc69a546f8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:34.953918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47db-280c-4436-92f1-83cc69a546f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:35.030421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f85e47db-280c-4436-92f1-83cc69a546f8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:35.031641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f85e47db-280c-4436-92f1-83cc69a546f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:35.081924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:35.131981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:35.417243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:35.418763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:35.522273 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e154-7cc6-41af-bb83-ee030f50b8bb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:35.569212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:35.597073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:35.597673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:35.597947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:35.598214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:35.599810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:35.705958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:35.707387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49165f74-9112-4215-a1eb-eb18e35bda02 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:35.726078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 733/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:45.130142 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=22 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:45.723842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=66 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:55.401857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4771-85f9-44a9-91f7-67d1d08b8d9f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.402439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4771-85f9-44a9-91f7-67d1d08b8d9f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.402439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4771-85f9-44a9-91f7-67d1d08b8d9f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.403828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 738/1471] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:55.409240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2cc2-571b-4fe0-b228-d7204ea216c5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.409706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2cc2-571b-4fe0-b228-d7204ea216c5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.409837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2cc2-571b-4fe0-b228-d7204ea216c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.479137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6e8f2cc2-571b-4fe0-b228-d7204ea216c5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:55.480366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6e8f2cc2-571b-4fe0-b228-d7204ea216c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:55.577453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 734/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:55.872243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.872525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.872794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.874122 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 739/1473] 10.222.0.50 () {54 vars in 967 bytes} [Wed Aug 24 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:55.879069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f2223-5216-45df-b658-434328bd82c7 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.879352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f2223-5216-45df-b658-434328bd82c7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.879620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f2223-5216-45df-b658-434328bd82c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.953824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c88f2223-5216-45df-b658-434328bd82c7 None None] MFA Rules not processed for user `6b0a6b75badb4d04a7d32044d2d61af2`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:55.955007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c88f2223-5216-45df-b658-434328bd82c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:55.975077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:56.029705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 735/1474] 10.222.0.50 () {58 vars in 1064 bytes} [Wed Aug 24 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:56.037385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:56.039412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:56.142822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c9685-3792-4735-ae1f-28e83ce3762f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:56.216524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:56.217128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:56.217409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:56.217677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:56.219272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:56.274941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:56.329744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:56.331216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6298aa-5ff2-4e6f-ac6c-fe0652270d0a service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:56.350238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 740/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:58.341284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:58.341802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:58.341802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:58.343164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 736/1476] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:58.348566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e89f0-9ef0-46a2-ad9e-738ae1e28c36 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:58.349006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e89f0-9ef0-46a2-ad9e-738ae1e28c36 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:58.349148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e89f0-9ef0-46a2-ad9e-738ae1e28c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:58.415758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e49e89f0-9ef0-46a2-ad9e-738ae1e28c36 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:58.417030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e49e89f0-9ef0-46a2-ad9e-738ae1e28c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:58.515736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 741/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:58.791659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:58.793145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:58.919023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74927dbb-c963-44fc-84b3-f3c4282f0a67 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:58.968447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:59.012969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:59.013572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:59.013851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:59.014122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:59.014756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:59.016500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:34:59.016500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:34:59.016500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:34:59.017632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75deb-6abd-43ba-ab51-fd1311ab917a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:59.039468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 737/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 24 10:34:58 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:35:00.993329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:00.993905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:00.993905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:00.995222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 742/1479] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:01.000922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723e2f-a84f-4b97-8fd4-6a274c14195f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:01.001359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723e2f-a84f-4b97-8fd4-6a274c14195f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:01.001471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723e2f-a84f-4b97-8fd4-6a274c14195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:01.070029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f8723e2f-a84f-4b97-8fd4-6a274c14195f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:01.071229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f8723e2f-a84f-4b97-8fd4-6a274c14195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:01.169114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 738/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:01.467657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:01.469216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:01.479514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:01.617845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d372f-df8d-4e8d-84d0-ade7a06dacde None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:01.697167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:01.730715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:01.731845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:01.732131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:01.732405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:01.734039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:01.821793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:01.823387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460fcaa-23c2-4e04-a98e-c82d712fd929 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:01.842250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 743/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:03.921949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:03.922538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:03.922538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:03.923846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 739/1482] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:03.929902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681cb0-f67e-44c0-bed9-12e9929196a1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:03.930347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681cb0-f67e-44c0-bed9-12e9929196a1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:03.930475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681cb0-f67e-44c0-bed9-12e9929196a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:03.996280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5b681cb0-f67e-44c0-bed9-12e9929196a1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:03.997815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5b681cb0-f67e-44c0-bed9-12e9929196a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:04.045895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:04.096264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 744/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:04.382972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:04.384560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:04.408567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:04.487815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de34a-a4e7-47c7-a94e-ba61c6de907c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:04.560376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:04.560982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:04.561259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:04.561526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:04.563119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:04.637131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:04.671342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:04.672799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c35c9-40cb-4b69-865e-96a22b0a56bd service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:04.691301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 740/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:06.674580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:06.675117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:06.675117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:06.676516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 745/1485] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:06.681866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147320-0d7c-434d-bd1b-c4940257a5cc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:06.682320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147320-0d7c-434d-bd1b-c4940257a5cc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:06.682426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147320-0d7c-434d-bd1b-c4940257a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:06.747971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b1147320-0d7c-434d-bd1b-c4940257a5cc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:06.749158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b1147320-0d7c-434d-bd1b-c4940257a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:06.844265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 741/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:07.134064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:07.135608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:07.243058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678ff1-e634-4ebb-b3a6-977d4368a569 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:07.324404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:07.326249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:07.326852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:07.327126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:07.327393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:07.329011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:07.440196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:07.441629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead827e-ef83-45e8-a176-c31e64a52606 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:07.461428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 746/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:09.550986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:09.551515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:09.551515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:09.553153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 742/1488] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:09.559630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c06-76f4-48de-8dfc-5a8bfbf6cb85 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:09.560099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c06-76f4-48de-8dfc-5a8bfbf6cb85 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:09.560215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c06-76f4-48de-8dfc-5a8bfbf6cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:09.626238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-40bf4c06-76f4-48de-8dfc-5a8bfbf6cb85 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:09.627462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-40bf4c06-76f4-48de-8dfc-5a8bfbf6cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:09.680201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:09.723691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 747/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:10.013050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:10.014634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:10.050892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:10.118953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e13cf-4d3a-4238-8648-366f081953c8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:10.192996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:10.193603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:10.193875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:10.194136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:10.195936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:10.277352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:10.306844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:10.308368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec487f9b-1db9-470e-83e8-771dbdf5914f service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:10.327231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 743/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:12.649076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:12.649600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:12.649600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:12.650869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 748/1491] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 24 10:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:12.656064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7926-8dac-41c8-943e-ac56bf759a92 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:12.656502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7926-8dac-41c8-943e-ac56bf759a92 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:12.656600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7926-8dac-41c8-943e-ac56bf759a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:12.723030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ac7f7926-8dac-41c8-943e-ac56bf759a92 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:12.724256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ac7f7926-8dac-41c8-943e-ac56bf759a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:12.817952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 744/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:35:13.107965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:13.109479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:13.213347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa204f-bc2c-49cf-ab4f-296c5af31b1e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:13.285278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:13.285871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:13.286143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:13.286404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:13.288577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:13.297776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:13.405757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:13.407117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20200-ca88-4a0b-bb0f-902965483ffb service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:13.426236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 749/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:22.816152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=82 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:23.423977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=50 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:44.827058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:44.827648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:44.827648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:44.914759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:44.916009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.022794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 745/1494] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:45.031372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.031913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.032020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.107760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:45.108914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.206765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 750/1495] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:45.211957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:45.213161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.224448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e194-68e4-4b78-94b8-1b8bf6b6ec7c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:45.286141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:45.322871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:45.323480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.323815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.324095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.324734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:36:45.325153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:45.326209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:45.326209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:36:45.326209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:36:45.327093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:45.339194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 746/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:36:45.347615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:45.356986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ec93-fbd0-41c6-a911-4cb7a7f9dda3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:45.419455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:45.453361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:45.453965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.454239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.454505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.455118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:45.456829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:45.456829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:36:45.456829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:36:45.458009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:45.575364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 751/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:36:45.579607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:45.581181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.615052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9786-02fa-4fac-9c41-e6250ec39237 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:45.711366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:45.711994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.712280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.712552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.713163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:45.714179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:45.714179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:36:45.714179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:36:45.715374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:45.861023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 747/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:36:45 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:36:45.865447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:45.870795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.929464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58c8a0-eb9b-40c2-a98f-2a65fc1d1cbe admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:46.017187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.027423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:46.028061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.028340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.028611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.029241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:46.030251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:46.030251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:36:46.030251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:36:46.031136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:46.043651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 752/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:36:46.047600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:46.049173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.061661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5889-3d47-4cf4-abf3-dceb17abfab9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:46.087997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.159450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:46.160081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.160359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.160627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.161287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:46.162946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:46.162946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:36:46.162946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:36:46.164185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b6fc8-d3fc-48a9-b4dd-e37063fe3fc2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:46.177158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 748/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:36:46.181487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:46.183020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.217251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3778ab-1677-42e7-9f75-6f435892c09f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:46.314264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:46.314920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.315194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.315462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] PATH_INFO: `/v3/projects/c02c692b1d0d45e69df2af0dc846fe8f/users/ea88ca1cbbc949078d0c76e2d4361dfe/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.337660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02c692b1d0d45e69df2af0dc846fe8f, user_id=ea88ca1cbbc949078d0c76e2d4361dfe, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:46.338680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:46.338680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:36:46.338680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:36:46.340663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5cc2-e869-411a-84fb-a15e1316226b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:46.402360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 753/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:36:46 2022] PUT /identity/v3/projects/c02c692b1d0d45e69df2af0dc846fe8f/users/ea88ca1cbbc949078d0c76e2d4361dfe/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:36:46.415017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d213-fcdc-476f-b6ed-57fe30ad91f3 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.415289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d213-fcdc-476f-b6ed-57fe30ad91f3 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.415560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d213-fcdc-476f-b6ed-57fe30ad91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.472402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7055d213-fcdc-476f-b6ed-57fe30ad91f3 None None] MFA Rules not processed for user `ea88ca1cbbc949078d0c76e2d4361dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:46.473688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7055d213-fcdc-476f-b6ed-57fe30ad91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.550605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 749/1502] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:46.564629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.564919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.565221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.566572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 754/1503] 10.222.0.50 () {54 vars in 964 bytes} [Wed Aug 24 10:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:46.571532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b8bc-52b7-44c2-81bb-2633a5530cf2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.571839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b8bc-52b7-44c2-81bb-2633a5530cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.572110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b8bc-52b7-44c2-81bb-2633a5530cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.603245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.646279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-df91b8bc-52b7-44c2-81bb-2633a5530cf2 None None] MFA Rules not processed for user `efa91470f945469798d16d84fbe4f35d`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:46.648233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-df91b8bc-52b7-44c2-81bb-2633a5530cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.725340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 750/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Aug 24 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:46.733471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:46.735028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.823068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.876055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc004f-475f-4396-9f74-9ad066269743 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:46.949015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:46.949611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.949883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.950143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.951716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.048341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:47.049760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:47.054232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.067234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 755/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:47.112815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16954-61c2-4641-bba2-5eb57ab2b85c None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.113212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16954-61c2-4641-bba2-5eb57ab2b85c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.113362 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16954-61c2-4641-bba2-5eb57ab2b85c None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.114671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 751/1506] 10.222.0.50 () {52 vars in 830 bytes} [Wed Aug 24 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:47.118499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:47.119696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.218092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147ffc-e0f8-4668-92e5-12121ae972b4 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:47.312162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:47.312791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.313067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.313336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] PATH_INFO: `/v3/users/ea88ca1cbbc949078d0c76e2d4361dfe` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.326049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea88ca1cbbc949078d0c76e2d4361dfe)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:47.327008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:47.327008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:36:47.327008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:36:47.328258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:47.338963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.571150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea88ca1cbbc949078d0c76e2d4361dfe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:47.571590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea88ca1cbbc949078d0c76e2d4361dfe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:47.595713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea88ca1cbbc949078d0c76e2d4361dfe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:47.670845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea88ca1cbbc949078d0c76e2d4361dfe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:47.687007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea88ca1cbbc949078d0c76e2d4361dfe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:47.692574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 756/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:36:47 2022] DELETE /identity/v3/users/ea88ca1cbbc949078d0c76e2d4361dfe => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:36:47.696968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.697257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.697539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.756721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:47.758120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.833781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.847283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 752/1508] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:47.857178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:47.858425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.961101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1410-83ab-4d32-84a2-921921831233 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:48.015735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:48.036296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:48.036923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:48.037508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:48.037993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:48.040057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:48.149991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:48.151351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82161eaa-be07-4173-9722-9c77e9ea27fd service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:48.169501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 757/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:48.679530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:48.680797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:48.692333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdab52-f78e-419c-92c4-631dbbf5a2fb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:48.792834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:48.793461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:48.793736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:48.794002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] PATH_INFO: `/v3/projects/c02c692b1d0d45e69df2af0dc846fe8f` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:48.804578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02c692b1d0d45e69df2af0dc846fe8f)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:48.805601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:36:48.805601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:36:48.805601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:36:48.806785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:48.922530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02c692b1d0d45e69df2af0dc846fe8f', 'request_id': 'req-73081e86-5963-4f9b-bbb7-c9b22ce954d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:48.935932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02c692b1d0d45e69df2af0dc846fe8f', 'request_id': 'req-73081e86-5963-4f9b-bbb7-c9b22ce954d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:49.006792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02c692b1d0d45e69df2af0dc846fe8f', 'request_id': 'req-73081e86-5963-4f9b-bbb7-c9b22ce954d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:49.030622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] The token cache is being invalidate because project c02c692b1d0d45e69df2af0dc846fe8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:36:49.030904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:49.031331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-73081e86-5963-4f9b-bbb7-c9b22ce954d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:36:49.032865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 753/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:36:48 2022] DELETE /identity/v3/projects/c02c692b1d0d45e69df2af0dc846fe8f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:36:58.167271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=62 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:59.028703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:26.613073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:26.613641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:26.613641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:26.614931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:26.619894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05945-234a-4b08-80d9-13b78e05d609 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:26.620309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05945-234a-4b08-80d9-13b78e05d609 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:26.620436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05945-234a-4b08-80d9-13b78e05d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:26.705089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2bd05945-234a-4b08-80d9-13b78e05d609 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:26.706278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2bd05945-234a-4b08-80d9-13b78e05d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:26.812121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:26.966917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:26.969001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:27.087993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c92c-6298-40a5-93e3-062bba58e97f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:27.093501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:27.094105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:27.094518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:27.094948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:27.103081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:27.104685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f96be-2ad5-4e31-82f3-a98930b1a9c0 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:27.114895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 759/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:27.957748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdef3ff-7f04-4c57-8008-cc1ed6e8489c None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:27.958305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdef3ff-7f04-4c57-8008-cc1ed6e8489c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:27.958305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdef3ff-7f04-4c57-8008-cc1ed6e8489c None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:27.959904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:27.964618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafbe7-898f-46d7-84aa-ba71601f34a4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:27.965022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafbe7-898f-46d7-84aa-ba71601f34a4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:27.965165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faafbe7-898f-46d7-84aa-ba71601f34a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:27.984584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8faafbe7-898f-46d7-84aa-ba71601f34a4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:27.986409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8faafbe7-898f-46d7-84aa-ba71601f34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:27.994267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:28.146970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdef3ff-7f04-4c57-8008-cc1ed6e8489c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:28.161523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdef3ff-7f04-4c57-8008-cc1ed6e8489c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:28.166906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:28.167489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:28.167763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:28.168061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:28.176705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:28.178264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea862-967f-4c47-961a-a72047876973 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:28.187390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 756/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:28.982106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018548b9-5d72-485b-8c6f-83633a88d922 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:28.982680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018548b9-5d72-485b-8c6f-83633a88d922 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:28.982680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018548b9-5d72-485b-8c6f-83633a88d922 None None] PATH_INFO: `/v3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:28.983946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 761/1517] 10.222.0.42 () {54 vars in 925 bytes} [Wed Aug 24 10:38:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:38:28.989957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ac67-b639-4483-b407-f10c132c30b7 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:28.990382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ac67-b639-4483-b407-f10c132c30b7 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:28.990511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767ac67-b639-4483-b407-f10c132c30b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:29.049436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4767ac67-b639-4483-b407-f10c132c30b7 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:29.050629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4767ac67-b639-4483-b407-f10c132c30b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:29.067071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:29.122225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 757/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:33.120058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361dd2d-f00a-440f-827e-aeb82e955a72 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:33.120599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361dd2d-f00a-440f-827e-aeb82e955a72 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:33.120599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361dd2d-f00a-440f-827e-aeb82e955a72 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:33.121874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 762/1519] 10.222.0.50 () {54 vars in 961 bytes} [Wed Aug 24 10:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:33.127104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e6b3-92c9-41c2-98f7-980c5055b8e6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:33.127521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e6b3-92c9-41c2-98f7-980c5055b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:33.127656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e6b3-92c9-41c2-98f7-980c5055b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:33.147570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0633e6b3-92c9-41c2-98f7-980c5055b8e6 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:33.148811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0633e6b3-92c9-41c2-98f7-980c5055b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:33.157933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 758/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Aug 24 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:33.165443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361dd2d-f00a-440f-827e-aeb82e955a72 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:33.179266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361dd2d-f00a-440f-827e-aeb82e955a72 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:33.184282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:33.184867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:33.185148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:33.185421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:33.194016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:33.195737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0bf19-4be1-4d9d-8ecf-f00cd5149dd7 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:33.206027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 763/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:38:39.438148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb8e3-61ce-46f6-8f81-3840a2b3eacc None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:39.438752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb8e3-61ce-46f6-8f81-3840a2b3eacc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:39.438752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb8e3-61ce-46f6-8f81-3840a2b3eacc None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:39.440087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:39.445724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4f0c-34cc-451f-859e-ee8e4d586f23 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:39.446148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4f0c-34cc-451f-859e-ee8e4d586f23 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:39.446255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4f0c-34cc-451f-859e-ee8e4d586f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:39.466689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-347e4f0c-34cc-451f-859e-ee8e4d586f23 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:39.467930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-347e4f0c-34cc-451f-859e-ee8e4d586f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:39.476135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:39.641225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceb8e3-61ce-46f6-8f81-3840a2b3eacc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:39.655486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceb8e3-61ce-46f6-8f81-3840a2b3eacc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:39.661255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f7d40-c024-4878-995f-876355669068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:39.661845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7d40-c024-4878-995f-876355669068 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:39.662124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7d40-c024-4878-995f-876355669068 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:39.662397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7d40-c024-4878-995f-876355669068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:39.670568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f7d40-c024-4878-995f-876355669068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:39.672243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f7d40-c024-4878-995f-876355669068 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:39.682506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 760/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:40.496717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2541-7bea-4b10-99e0-f073c8efa170 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:40.497274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2541-7bea-4b10-99e0-f073c8efa170 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:40.497274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c2541-7bea-4b10-99e0-f073c8efa170 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:40.498580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:40.503631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f1d6-1dd7-4fa8-a5eb-1f8071ef7978 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:40.504244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f1d6-1dd7-4fa8-a5eb-1f8071ef7978 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:40.504244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f1d6-1dd7-4fa8-a5eb-1f8071ef7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:40.523427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1a64f1d6-1dd7-4fa8-a5eb-1f8071ef7978 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:40.524643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1a64f1d6-1dd7-4fa8-a5eb-1f8071ef7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:40.532320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:40.682555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c2541-7bea-4b10-99e0-f073c8efa170 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:40.697350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c2541-7bea-4b10-99e0-f073c8efa170 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:40.702747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:40.703331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:40.703609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:40.703918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:40.712774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:40.714334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722f2d-a2b9-4c1f-8ee6-1fedef999101 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:40.723590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 766/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:44.598272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a4093-339f-4c49-9889-549200786a29 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:44.598799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a4093-339f-4c49-9889-549200786a29 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:44.598799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a4093-339f-4c49-9889-549200786a29 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:44.600118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:44.605510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cc0-2c4b-44c3-b946-de5e64e7f95f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:44.605985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cc0-2c4b-44c3-b946-de5e64e7f95f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:44.606095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cc0-2c4b-44c3-b946-de5e64e7f95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:44.628563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-28f72cc0-2c4b-44c3-b946-de5e64e7f95f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:44.629760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-28f72cc0-2c4b-44c3-b946-de5e64e7f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:44.637740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:44.934438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a4093-339f-4c49-9889-549200786a29 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:44.936155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e49a4093-339f-4c49-9889-549200786a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:45.014293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a4093-339f-4c49-9889-549200786a29 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:45.021149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:45.021149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:45.021149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:45.021149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:45.030173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:45.031618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a37e0-8d89-481b-b641-c5d2620a1d34 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:45.041907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 763/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:46.933714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991a13-0c26-4fd5-b80b-34f57ce782e1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:46.934263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991a13-0c26-4fd5-b80b-34f57ce782e1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:46.934263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991a13-0c26-4fd5-b80b-34f57ce782e1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:46.935622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:46.941491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb7d3-8222-4660-b2e3-0a33adb68c3a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:46.942000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb7d3-8222-4660-b2e3-0a33adb68c3a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:46.942000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb7d3-8222-4660-b2e3-0a33adb68c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:46.961673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0e9bb7d3-8222-4660-b2e3-0a33adb68c3a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:46.962843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0e9bb7d3-8222-4660-b2e3-0a33adb68c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:46.970607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:47.254339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991a13-0c26-4fd5-b80b-34f57ce782e1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:47.265258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991a13-0c26-4fd5-b80b-34f57ce782e1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:47.269659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:47.270188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:47.270467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:47.270931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:47.279555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:47.281003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43da84-e7fb-470f-b10a-ffd906bfb697 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:47.291450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 769/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:50.903454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:50.904046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:50.904046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:50.905408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:50.911176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1e85-e4e6-43cc-9c1e-ec6e8310cb29 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:50.911591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1e85-e4e6-43cc-9c1e-ec6e8310cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:50.911735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1e85-e4e6-43cc-9c1e-ec6e8310cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:50.919286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=81 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:50.931319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3d8b1e85-e4e6-43cc-9c1e-ec6e8310cb29 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:50.932566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3d8b1e85-e4e6-43cc-9c1e-ec6e8310cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:50.940572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:51.497278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:51.498954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:51.564611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:51.577530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148cd12-9b8d-4cb9-9589-f424817baf7d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:51.581737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:51.582475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:51.582753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:51.583024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:51.592320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:51.593959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ff60-549b-47d8-a022-9ab8bfafe50a service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:51.604031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 766/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:38:53.543436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:53.544035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:53.544035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:53.545402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:38:53.551045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdfa36-d94a-4e97-9d30-7f8713f41b3f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:53.551465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdfa36-d94a-4e97-9d30-7f8713f41b3f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:53.551578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdfa36-d94a-4e97-9d30-7f8713f41b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:53.571525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-60cdfa36-d94a-4e97-9d30-7f8713f41b3f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:38:53.572760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-60cdfa36-d94a-4e97-9d30-7f8713f41b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:53.580608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:38:54.129617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:38:54.131291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:38:54.144749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171140-d3be-4b50-b7c9-c54f9bfe4c72 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:38:54.148731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:38:54.149334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:38:54.149607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:38:54.149875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:38:54.158909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:38:54.161032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae797b7-f1e3-453d-85a0-47bd71278e18 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:38:54.173421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 772/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:03.565622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=11 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:04.167185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:21.933474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:21.943433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:21.943433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:21.962055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:21.963452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:21.977702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 768/1540] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:21.986480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:21.987084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:21.987084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.014426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.015671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.026809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 773/1541] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.031266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.046706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d67ec0-c9c0-4b5d-9c33-138fe42723ea None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.052349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.052960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.053235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.053502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.054287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.054590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.056214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648692e6-09f4-4a97-9506-879c11e0939d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.073207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 769/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.082063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.091989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161e5ea-651a-4881-8536-23367edd3eb9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.104244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.104869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.105145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.105416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.106043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.107965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8160-6cbd-4bc8-a362-70c617958db8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.124731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a622db-cc31-4811-93af-5d628abddb8f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.125144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a622db-cc31-4811-93af-5d628abddb8f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.125429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a622db-cc31-4811-93af-5d628abddb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.160177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-59a622db-cc31-4811-93af-5d628abddb8f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.165511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-59a622db-cc31-4811-93af-5d628abddb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.176523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 770/1543] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 10:40:22.177800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941c1e-0d11-4339-a1a3-46a8cde0fb96 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.178080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941c1e-0d11-4339-a1a3-46a8cde0fb96 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.178345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941c1e-0d11-4339-a1a3-46a8cde0fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.203471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9d941c1e-0d11-4339-a1a3-46a8cde0fb96 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.204654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9d941c1e-0d11-4339-a1a3-46a8cde0fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.224041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 771/1544] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.225321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ee45-08bd-4f70-af23-b4d15e0af2da None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.225602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ee45-08bd-4f70-af23-b4d15e0af2da None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.225871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ee45-08bd-4f70-af23-b4d15e0af2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.245683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 774/1545] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:22.247016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157d54-6dd4-47df-a8ec-f246c0287cb5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.247134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2737ee45-08bd-4f70-af23-b4d15e0af2da None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.247328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157d54-6dd4-47df-a8ec-f246c0287cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.247569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157d54-6dd4-47df-a8ec-f246c0287cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.248258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2737ee45-08bd-4f70-af23-b4d15e0af2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.287012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a9157d54-6dd4-47df-a8ec-f246c0287cb5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.288281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a9157d54-6dd4-47df-a8ec-f246c0287cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.317274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 772/1546] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.318659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cafd50-8643-43c9-8ac3-6c02765c5f33 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.318659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cafd50-8643-43c9-8ac3-6c02765c5f33 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.318877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cafd50-8643-43c9-8ac3-6c02765c5f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.338593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-96cafd50-8643-43c9-8ac3-6c02765c5f33 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.339809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-96cafd50-8643-43c9-8ac3-6c02765c5f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.349495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 773/1547] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.351055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.351683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.352210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.378065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.379483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.388268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 774/1548] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.389025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.398514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 775/1549] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.399873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.400165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.400441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.404044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb082-88ca-486c-a2df-432e1c8c5fd1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.411335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.411946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.412226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.412501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.414016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.415129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127f4a8-5cd3-4934-8262-46d5e4b420a6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.425393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.426769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.435289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 776/1550] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.436607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.446445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b586de-e170-41af-8ac1-da3fd08faea3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.451133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.451720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.452033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.452303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.452939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.453237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.454338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:22.454338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:40:22.454338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:40:22.455162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec59b35-beae-458d-a041-9e4699a456b5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.467227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 777/1551] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.468486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.468766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.469036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.488961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.490191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.498352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 778/1552] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.499257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.508654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb72d0-a6f4-4104-b44d-e90bdfb9d7c6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.513283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.513869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.514142 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.514410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.515043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.515343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.516957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8d0f6-c260-411f-a494-29422eac1cd6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.519425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 775/1553] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/users => generated 302 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:22.520568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214308a5-5eb9-4a3e-afcf-53c062a72ff1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.520849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214308a5-5eb9-4a3e-afcf-53c062a72ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.521120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214308a5-5eb9-4a3e-afcf-53c062a72ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.532784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 779/1554] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.532956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3ff3b-5843-4f1d-9b34-fad786a0fffb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.533156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3ff3b-5843-4f1d-9b34-fad786a0fffb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.533489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3ff3b-5843-4f1d-9b34-fad786a0fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.547364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-214308a5-5eb9-4a3e-afcf-53c062a72ff1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.548598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-214308a5-5eb9-4a3e-afcf-53c062a72ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.553778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-edb3ff3b-5843-4f1d-9b34-fad786a0fffb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.554939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-edb3ff3b-5843-4f1d-9b34-fad786a0fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.557488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 776/1555] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.558664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.558946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.559216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.564793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 780/1556] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.566076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f7de-2efe-4346-8349-3336bf4c124b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.566360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f7de-2efe-4346-8349-3336bf4c124b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.566633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334f7de-2efe-4346-8349-3336bf4c124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.578800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.580017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.587138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5334f7de-2efe-4346-8349-3336bf4c124b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.588353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5334f7de-2efe-4346-8349-3336bf4c124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.590220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 777/1557] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.590966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.597236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 781/1558] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.598923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.599315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.599483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.602144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363a408-647e-414b-8b95-b8dd0feb9d27 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.606888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.607489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.607764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.608076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.608696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.609711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:22.609711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:40:22.609711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:40:22.610884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.619349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.620584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.628891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 782/1559] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.629693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.638964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265ef8-a0b3-44b4-aff1-7cf39fa67f1d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.643683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.644987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.645266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.645538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.646175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.647763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.657612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 783/1560] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:22.658369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.668396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27692d4-4429-46e1-8029-effb8f3343e6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.673102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.673660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.673942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.674215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.675472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.677417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.725228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 778/1561] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:22.726023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.773124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 784/1562] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:22.773124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.790610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4e56-d0f0-4423-ae4b-39c41d324224 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.795765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:22.805365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:22.834498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95848bf-3c3e-4fb9-8ec6-7a0b548b06b8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.839150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.839752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.840056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.840322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.840951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.841244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.842870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f3d1-dbcc-4ce5-99a0-9373642d75fc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.849792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.850401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.850675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.850953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.851594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.851986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.853574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.854983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 785/1563] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.854983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.854983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.854983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.866035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 779/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.866748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.876464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752683-f315-4529-b295-732c258c81a9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.878803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:22.880020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:22.881357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.882016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.882292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.882560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.883244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.883595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.885236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.888020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 786/1565] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:22.888795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.907554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 780/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.907766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8752-56d9-4cc7-acf3-eb72ba60a410 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.907911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.908026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.908026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.908026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.908026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.908403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:22.908403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.910752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.914523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8e7f-d362-4acd-b7a6-a81ed5d53340 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.919211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.919834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.920107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.920372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.920999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.922570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.923184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 787/1567] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:22.924038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.933045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 781/1568] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:22.933713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:22.934302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4d905-8933-47f7-a2fe-2d2ad761d0b2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.938639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.939358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.939680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.939985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.940650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.941653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:22.941653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:40:22.941653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:40:22.942843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:22.943302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0626b0-bf46-4d2e-8a19-a24fcc3a9682 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:22.947758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:22.948353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:22.948627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:22.948893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:22.949500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:22.951462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.058339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 788/1569] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.058339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.066304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084d12-6f6a-4588-b387-a3c739aec885 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.071024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.071604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.071917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.072191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.072805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.074801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.089869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 782/1570] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:22 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.090721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.101841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e1d1-25b9-4fe5-9fe7-2e4474933a5e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.106423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.107003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.107277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.107561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.108185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.110099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.168951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 789/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.169921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.193311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 783/1572] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.193311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.233467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babab8c-66c0-4a2b-9188-5639a82949e4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.258905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008227a-f83a-4734-b9d7-bca34cce5900 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.263775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.264415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.264693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.265014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.265590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.267539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.292188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.292792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.293078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.293350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.293990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:23.294295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.295920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.308057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 790/1573] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:23.308984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.320517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1ebd-9280-45f0-8d16-90c7c2e09362 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.325153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.325747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.326061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.326327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.326944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.328911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.334508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:23.352072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 784/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.352913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.379895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:23.414355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbae1c7-3a10-4c6a-987c-cf5cbf5b24a8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.418944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.419591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.419898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.420173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] PATH_INFO: `/v3/projects/99106baf4a0c420a90a6bbcf2d4becae/users/373afc28ff8d49bfa370eb6b031c6a4a/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.434722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99106baf4a0c420a90a6bbcf2d4becae, user_id=373afc28ff8d49bfa370eb6b031c6a4a, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.435907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:23.435907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:40:23.435907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:40:23.437918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.439512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 791/1575] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/projects => generated 353 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.441806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.505072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64433685-ae2a-4bb5-98ca-6b1782fb3a35 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.509665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.510257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.510554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.510818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.511446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.513065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.524039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 792/1576] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:23.524997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.536184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334417bc-4ee3-495b-84d2-3ba9d19a7945 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.536543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 785/1577] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:23 2022] PUT /identity/v3/projects/99106baf4a0c420a90a6bbcf2d4becae/users/373afc28ff8d49bfa370eb6b031c6a4a/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:23.547211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.593789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.594365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.594644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.594912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.595545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.597913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.607660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 793/1578] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:23.608461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.610238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6717d5-0c2c-4a28-9093-5a19ad1ffea9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.615021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.615625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.615936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.616210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.616939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.618881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.620134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367d66-eca0-4a43-b82a-a94bf16f3eca admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.624709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.625283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.625559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.625825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.626427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.628470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.731601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 786/1579] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.731601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.738745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be55d-b8c7-46c9-a6f3-4edddb10cf4a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.743290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.743887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.744167 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.744435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.745033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.746909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.757900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 794/1580] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.757900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.767033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06070-9fe4-436a-bb9f-e6550d25f823 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.772751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.773343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.773627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.773901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.774522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.776563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.840360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 787/1581] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.841180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.866006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 795/1582] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.866872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:23.876595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df5d20-2817-45b6-b377-2ff08ae5e544 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.906220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a70fb-8133-40c0-9da6-4846425ca1c4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:23.911730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.912366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.912647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.912940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.913593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.915651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.917972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:23.934718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:23.935330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.935609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.935951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.936622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:23.938215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ec13-61f3-419f-939b-ed1ccb9ad545 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:23.951625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 796/1583] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:23.951625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:23.951625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:23.951625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:23.978841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] MFA Rules not processed for user `373afc28ff8d49bfa370eb6b031c6a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:23.980080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:23.996604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 788/1584] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/users => generated 277 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:23.997374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.004388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:24.008114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f1e19-4754-45c0-ab0a-c362ff99c858 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.012734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.013317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.013592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.013898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.014489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.016116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.027504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 789/1585] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.028345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.037839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5877-e183-409c-9029-c475bc7cf4ee admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.042348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.042929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.043203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.043470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.044124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.045687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.048801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 797/1586] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:24.049675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.058023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 790/1587] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.058023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.062467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec768-b438-4e0c-ac9d-b9be5b051291 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.067754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.068391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.068537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4378-a29d-4260-80df-caa669bfe11c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.068665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.068929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.069566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.071165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.073022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.073595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.073868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.074135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.074740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.076648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.082187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 798/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.083087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.094435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82688b7-ad86-4c4e-b31d-0bf32a745005 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.099355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.100021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.100299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.100570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.101197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.102778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.112640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 799/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.113396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.122790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314018be-8475-4b15-ab4e-a430b0d1d4d7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.127352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.129951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.129951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.129951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] PATH_INFO: `/v3/projects/6f0c590b7bac45f097c4269c216180a8/users/2c1bb573a5b94e4ea64ab9775384fd91/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.145213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0c590b7bac45f097c4269c216180a8, user_id=2c1bb573a5b94e4ea64ab9775384fd91, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.147842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.154394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 791/1590] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:24.154394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.162015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b26b-d901-44d5-9a55-3141ef059f87 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.166673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.167246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.167522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.167825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.168455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.170026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.180530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 792/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.181277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.191488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3701-b3f9-460c-9e25-5bf5a3b4ac87 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.196133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.196801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.197075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.197349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] PATH_INFO: `/v3/projects/adfbd67c9df44e10ae7b19d9c75d5947/users/806a6eb77a06442481ecc1a4004ee57b/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.214260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfbd67c9df44e10ae7b19d9c75d5947, user_id=806a6eb77a06442481ecc1a4004ee57b, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.216946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.237927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 800/1592] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/6f0c590b7bac45f097c4269c216180a8/users/2c1bb573a5b94e4ea64ab9775384fd91/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:24.238722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.290043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 793/1593] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/adfbd67c9df44e10ae7b19d9c75d5947/users/806a6eb77a06442481ecc1a4004ee57b/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:24.291179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.299010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e45bf7-1416-4cda-b946-d587d1081cec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.326965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:24.357420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.358226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.358313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.358555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.359091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadebde-204c-4222-bca1-3f7630f1cef5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.359269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.361236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e35fde-1a15-469a-8349-024909a20cc8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.364752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.365368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.365642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.365931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.366576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.368201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.379150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 794/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.380089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.389714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f78e-f874-4a7f-91e9-b89784d871e6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.394508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.395105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.395377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.395642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.396289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.397844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.407377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 795/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.410926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.417501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9ff1-29c8-4019-a5cd-d58afadadda6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.422049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.422604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.422879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.423147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.423753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.425946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.436053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 796/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.436821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.446689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444459a-d8df-461c-9197-cd9f0eedabc3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.451212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.451752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.452064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.452329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.452933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.454450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.464509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 797/1597] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.465151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.470673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 801/1598] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:24.484130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.484130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.484130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.484401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad27932-3ea9-4877-be79-8b753d04d6f2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.500757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] MFA Rules not processed for user `2c1bb573a5b94e4ea64ab9775384fd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:24.501986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:24.526397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:24.535528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.536148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.536488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.536790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.537428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.539032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80f5e9-25b7-478a-bb71-c8b0b3742bc7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.553610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 798/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.553610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.553610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.553610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.569357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 802/1600] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:24.570180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.572161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:24.576808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:24.581491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34e04-eba3-4417-86bb-34eff79d1134 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.583593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 799/1601] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:24.584348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.593786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.594184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6b55-231e-4e02-92da-36c09e286033 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.594873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.595356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.595859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] PATH_INFO: `/v3/projects/061f034f4888456fa9377affd9cb5ca1/users/b51ab52dfba64392ad65d894c6dadb5a/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.601459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.602274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.602643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.602964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] PATH_INFO: `/v3/projects/8f924e11dbb2467bacf290322722107b/users/a2d8ea9ed6094f0d955ab82be5b13848/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.613875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061f034f4888456fa9377affd9cb5ca1, user_id=b51ab52dfba64392ad65d894c6dadb5a, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.616618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.618584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f924e11dbb2467bacf290322722107b, user_id=a2d8ea9ed6094f0d955ab82be5b13848, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.621234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.712430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 803/1602] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/061f034f4888456fa9377affd9cb5ca1/users/b51ab52dfba64392ad65d894c6dadb5a/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:24.713948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.725179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 800/1603] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/8f924e11dbb2467bacf290322722107b/users/a2d8ea9ed6094f0d955ab82be5b13848/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:24.726074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.787973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23a52-c93d-4b95-b9e4-2dbe70bc5425 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.792968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.793210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.793516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.793904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] PATH_INFO: `/v3/projects/2e1369d542a94886b52b2ebe43d2e3a5/users/caa000b3f2f242a7a1418c3a56bdc55c/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.796149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d042-4ed4-4779-ae95-f5e830e308c5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.801483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.802079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.802351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.802618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.803248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.804865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.808739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1369d542a94886b52b2ebe43d2e3a5, user_id=caa000b3f2f242a7a1418c3a56bdc55c, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.811345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.815063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 801/1604] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:24.815898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.825150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9218b-6d6c-4acb-bbba-5f81350f38e6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.829715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.830278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.830555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.830915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.831522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.833751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.884168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 804/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/2e1369d542a94886b52b2ebe43d2e3a5/users/caa000b3f2f242a7a1418c3a56bdc55c/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:24.885014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.889249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:24.910441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 802/1606] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:24.910441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:24.918152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec76e40-b681-45e5-9101-6a696c36ea5d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.948131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4df2-270a-4273-ad7d-4bf6857c05f3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:24.953402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.954066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.954347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.954620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] PATH_INFO: `/v3/projects/1f9186f4423c47d6b96e600f8b41d122/users/52e784874ed242e9afbe15ea03ead0c4/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.969822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9186f4423c47d6b96e600f8b41d122, user_id=52e784874ed242e9afbe15ea03ead0c4, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.972993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:24.975759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:24.976394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:24.976670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:24.976935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:24.977549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:24.979420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dd4e7-0821-435e-af91-66b5bc2d3ed2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.038964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 805/1607] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:24 2022] PUT /identity/v3/projects/1f9186f4423c47d6b96e600f8b41d122/users/52e784874ed242e9afbe15ea03ead0c4/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:25.039808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.075294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 803/1608] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:24 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:25.075856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28abb2-9438-4587-b33b-50037773909f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.075856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28abb2-9438-4587-b33b-50037773909f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.076319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28abb2-9438-4587-b33b-50037773909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.094001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3525778-a5e2-4576-b32d-720201cbe6d6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.097790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7d28abb2-9438-4587-b33b-50037773909f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:25.099039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7d28abb2-9438-4587-b33b-50037773909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.115947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:25.142132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.142725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.143003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.143273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.157609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 804/1609] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:25.159637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20872-5b8e-425b-83d6-2a8a907fc9a1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.160055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20872-5b8e-425b-83d6-2a8a907fc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.160487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20872-5b8e-425b-83d6-2a8a907fc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.189071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7ba20872-5b8e-425b-83d6-2a8a907fc9a1 None None] MFA Rules not processed for user `a2d8ea9ed6094f0d955ab82be5b13848`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:25.190270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7ba20872-5b8e-425b-83d6-2a8a907fc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.197372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:25.208045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.209495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.218859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 806/1610] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:25.219641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.229353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6f4c-d6ae-4749-be3e-2a69fcdacdf1 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.236149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.237013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.237013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.237685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] PATH_INFO: `/v3/projects/2a4111b3b43247669bd40f0acd6caee2/users/7e35335d035c44daaf79627c255e9278/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.253583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4111b3b43247669bd40f0acd6caee2, user_id=7e35335d035c44daaf79627c255e9278, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.256538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.259699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 805/1611] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:25.261175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.261456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.261726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.280421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:25.281611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.289738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 806/1612] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:25.292432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.300964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e48bd-51e4-4de4-8d88-bbf68a35745b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.306055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.306691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.306968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.307241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.307938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.309576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4787664-8e14-42ba-8e16-dd96d31f90f4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.320387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 807/1613] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:25.324618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.324904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.325174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.351347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 807/1614] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:25 2022] PUT /identity/v3/projects/2a4111b3b43247669bd40f0acd6caee2/users/7e35335d035c44daaf79627c255e9278/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:25.351347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.359374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] MFA Rules not processed for user `52e784874ed242e9afbe15ea03ead0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:25.360623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.421928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52eb2-4952-43b6-864b-3ab921485283 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.429809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.430021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.430310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.430573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.431202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.433155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.438226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 808/1615] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:25.439158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.467326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:25.494491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b892f-4a9f-4899-b6aa-eeefbebed342 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.498055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.498657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.498933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.499201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.508596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.510022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.519826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 809/1616] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:25.520677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.529558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbae0a-5cf5-416c-8b8b-da6c72a26cf8 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.534173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.534736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.535014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.535282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.535944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.537846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df06c58-bcb7-4930-8563-4007539d01f7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.545507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 808/1617] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:25.545507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.555814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7a83e-03b8-4f6e-a0ef-34edf5b75049 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.560049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.560664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.560939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.561206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.571819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.573245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.584269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 809/1618] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:25.585095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.594450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41a2a-1ec4-4b07-b49a-8cce5994d187 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.599447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.600126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.600405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.600679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] PATH_INFO: `/v3/projects/5e0c511affc34ce1abb8f703185c73f6/users/8c52bae058e7494aa799e7de0e8beb78/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.616442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c511affc34ce1abb8f703185c73f6, user_id=8c52bae058e7494aa799e7de0e8beb78, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.619294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.637956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 810/1619] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:25.637956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.637956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.637956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.655441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:25.656676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.722092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 810/1620] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:25 2022] PUT /identity/v3/projects/5e0c511affc34ce1abb8f703185c73f6/users/8c52bae058e7494aa799e7de0e8beb78/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:25.722092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.731593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 811/1621] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:25.732884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.751120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20c2a4-d717-491c-8c9e-a9ea5c99b0ca None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.798508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980494b-95c9-4dab-a6df-2c4574555908 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.803873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.804697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.805077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.805408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.806343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.808309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.814354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.814354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.814354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.814354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.815270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.816016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.832643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 812/1622] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:25.832643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.841285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935af86-e08b-48b9-8dbb-10eb60503631 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:25.845883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:25.847071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:25.847352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:25.847622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:25.848265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:25.850207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:25.932361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 811/1623] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/projects => generated 357 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:25.932361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.936496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:25.961543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 813/1624] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:25 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:25.962702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:25.964538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:25.999414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973bed-b5b6-495c-9ee1-065e044de54f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.005608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:26.007471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.008420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.008766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.011951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.011951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.011951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.041214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 812/1625] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:26.042155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.049694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7145-d738-4439-92a0-94c029d88160 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.065422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c15cc0-27f1-435e-bf87-ce3176823fbb admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.071875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.072707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.073092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.073444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] PATH_INFO: `/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62/users/69eedd014f94488587c1812597850a02/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.092923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa9c9cd9624d049f49c56bf91e6f62, user_id=69eedd014f94488587c1812597850a02, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.096413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.126561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.127173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.127451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.127722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.137189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.138661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.149706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 814/1626] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:26.150563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.159977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50db449-798d-499a-abcc-7515dbbe10ca service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.165444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.166302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.166681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.167045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.168011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.170908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.172346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 813/1627] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:26 2022] PUT /identity/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62/users/69eedd014f94488587c1812597850a02/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:26.173729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.244036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 815/1628] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:26 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:26.244689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.262203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88633-0f17-4e2f-b29f-41a970bc42b2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.262445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4427-f971-4c0f-8ca9-d965e38e0bd8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.264985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.265814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.266094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.266359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.267417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.268377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.269607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.270446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.270870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.271476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] PATH_INFO: `/v3/projects/5e0c511affc34ce1abb8f703185c73f6/users/8c52bae058e7494aa799e7de0e8beb78/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.274486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c511affc34ce1abb8f703185c73f6, user_id=8c52bae058e7494aa799e7de0e8beb78, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.277965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.286123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 814/1629] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:26.287450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.297699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 816/1630] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:26 2022] PUT /identity/v3/projects/5e0c511affc34ce1abb8f703185c73f6/users/8c52bae058e7494aa799e7de0e8beb78/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:26.297699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.304813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb713-ddbf-4076-b9b7-78a985d4d78d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.405591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.406453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.406626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.406985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.407634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.413639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.413794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7472cb-c45b-483b-b811-8b87f6091aec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.418507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.419171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.419453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.419731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.420903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.422908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b0ee-ad76-42f8-b495-64a17e5d994f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.425844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 815/1631] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:26.426775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.439727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 817/1632] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:26.439963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfcb3-4edc-419f-9c38-475fdf76d973 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.440067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.440067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.440067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.445104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.445785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.446066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.446384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] PATH_INFO: `/v3/projects/39234cbe1618464fb8acda502a8dbccd/users/0d63609f11c646958758f78131b1c26b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.452047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:26.476121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] MFA Rules not processed for user `8c52bae058e7494aa799e7de0e8beb78`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:26.477332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:26.479661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39234cbe1618464fb8acda502a8dbccd, user_id=0d63609f11c646958758f78131b1c26b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.487409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.545771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:26.552114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 818/1633] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:26.553158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.566113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef8108-f3ed-43a9-b326-5cad9ccce762 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.571531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.572238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.572517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.579635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] PATH_INFO: `/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62/users/69eedd014f94488587c1812597850a02/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.579635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa9c9cd9624d049f49c56bf91e6f62, user_id=69eedd014f94488587c1812597850a02, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.581459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.606863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 819/1634] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:26 2022] PUT /identity/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62/users/69eedd014f94488587c1812597850a02/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:26.608042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.614066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 816/1635] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:26 2022] PUT /identity/v3/projects/39234cbe1618464fb8acda502a8dbccd/users/0d63609f11c646958758f78131b1c26b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:26.616846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:26.699126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d29c-5238-40b4-bd3b-db0d47a64128 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.732893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a724c2-720b-401e-99fb-94b6def422f2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:26.739554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.740891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.741411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.742354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.817518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:26.818210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.818545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.818907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] PATH_INFO: `/v3/projects/2228405bbe2f4005996fdda06a8d7116/users/f9b429544eb04e79be9f13cc62c4dd21/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.827398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.829401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ee7d4-f47a-49f6-92d2-a1c8eefee723 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.835382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2228405bbe2f4005996fdda06a8d7116, user_id=f9b429544eb04e79be9f13cc62c4dd21, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:26.838141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:26.843961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 817/1636] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:26 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:26.845530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:26.845960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:26.846348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:26.878070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] MFA Rules not processed for user `69eedd014f94488587c1812597850a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:26.880069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:26.918778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 820/1637] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:26 2022] PUT /identity/v3/projects/2228405bbe2f4005996fdda06a8d7116/users/f9b429544eb04e79be9f13cc62c4dd21/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:26.920113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.008468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 818/1638] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:27.008468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.021175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2ec4-ea1d-4dd5-a0e4-3942f8d48e02 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.024073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e6abb-fffa-4ce7-9678-b01ac6254202 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.026679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.028253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.028644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.028999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.029954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.030117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.030558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.030834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.031606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.032041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.032305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.034268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.045857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 819/1639] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:27.047115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.062752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:27.082016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 821/1640] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:27.082016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.098586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa1141-f694-4306-9022-096fb3ae88c6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.104893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:27.111996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.113807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.114372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.114855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] PATH_INFO: `/v3/projects/2228405bbe2f4005996fdda06a8d7116/users/f9b429544eb04e79be9f13cc62c4dd21/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.119920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2228405bbe2f4005996fdda06a8d7116, user_id=f9b429544eb04e79be9f13cc62c4dd21, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.124658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.162025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328e11e-4808-4b13-b4ae-16673bf7f366 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.173087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 822/1641] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:27 2022] PUT /identity/v3/projects/2228405bbe2f4005996fdda06a8d7116/users/f9b429544eb04e79be9f13cc62c4dd21/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:27.173087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.257532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.258182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.258464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.258754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.284341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999b6d3-a84c-43d2-926e-f930b07b715c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.291123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.291943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.292225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.292551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] PATH_INFO: `/v3/projects/39234cbe1618464fb8acda502a8dbccd/users/0d63609f11c646958758f78131b1c26b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.431316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39234cbe1618464fb8acda502a8dbccd, user_id=0d63609f11c646958758f78131b1c26b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.431316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.431316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 823/1642] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:27 2022] PUT /identity/v3/projects/39234cbe1618464fb8acda502a8dbccd/users/0d63609f11c646958758f78131b1c26b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:27.431316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.432168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.432168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57d082-ef5a-46b1-8798-97232b462211 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.436000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 820/1643] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:27.441054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a922171-9a22-4f47-a035-85fd5faea64d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.441054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a922171-9a22-4f47-a035-85fd5faea64d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.441054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a922171-9a22-4f47-a035-85fd5faea64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.470039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a922171-9a22-4f47-a035-85fd5faea64d None None] MFA Rules not processed for user `f9b429544eb04e79be9f13cc62c4dd21`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:27.475349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a922171-9a22-4f47-a035-85fd5faea64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:27.533023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c460c-4c83-4df0-b84e-80cf2bb315a8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.539765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.540804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.541107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.541369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] PATH_INFO: `/v3/users/373afc28ff8d49bfa370eb6b031c6a4a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.542546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373afc28ff8d49bfa370eb6b031c6a4a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.543764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: WARNING py.warnings [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:27.543764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: warnings.warn(msg) Aug 24 10:40:27.543764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: Aug 24 10:40:27.545758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.578352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 821/1644] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:27.578352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.578352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.578671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.634960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] MFA Rules not processed for user `0d63609f11c646958758f78131b1c26b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:27.642459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:27.731775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 822/1645] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:27.733248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.807403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f8b8b-e6ee-4149-ac46-d130c0e16e8d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.811273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.811964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.812246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.812520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.822405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.823929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.834226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 823/1646] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:27.835033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:27.848985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a430-9828-404b-a4fb-160bff4d4213 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:27.853900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:27.854641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:27.855315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:27.855315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:27.869303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:27.874300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:27.880977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 824/1647] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:27.884234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373afc28ff8d49bfa370eb6b031c6a4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:27.884880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373afc28ff8d49bfa370eb6b031c6a4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:27.904858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373afc28ff8d49bfa370eb6b031c6a4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:27.922494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:28.020683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:28.030467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6eaeb-c454-4893-b03d-5edd76eb7116 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:28.034677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:28.035363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:28.035641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:28.035978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:28.037824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.058859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373afc28ff8d49bfa370eb6b031c6a4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:28.085100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-2207e6ab-bbd0-49db-892f-4e18a1c26926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373afc28ff8d49bfa370eb6b031c6a4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:28.098750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 824/1648] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:27 2022] DELETE /identity/v3/users/373afc28ff8d49bfa370eb6b031c6a4a => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:28.104242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:28.104556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:28.104911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:28.443923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:28.443923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.457325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:28.457325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:28.457325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 825/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:28.458976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:28.458976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 825/1650] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:28.459715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:28.459715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.459715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27490-1a44-4e51-9e92-53796190f913 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:28.460849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:28.460849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.466784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:28.466784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:28.468386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:28.468386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:28.494139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:28.498170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:28.519828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 826/1651] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:28.579918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6158cc-98f1-4fe7-b45f-f19f98b49601 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:28.587313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:28.588128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:28.590128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:28.590417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:28.593332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.650245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:28.695397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:28.696984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:28.708033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 826/1652] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:40:28.953324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:28.956195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:28.974214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174007a-6059-40a5-97d6-ae39e15ec89c service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:28.982627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:28.988695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:28.994719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:29.000512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:29.006167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:29.112731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:29.114950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:29.133663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 827/1653] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:30.109005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:30.110452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:30.157144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad5c9-fa8a-4757-bcdc-800754e81436 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:30.169591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:30.170201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:30.170584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:30.170873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] PATH_INFO: `/v3/projects/99106baf4a0c420a90a6bbcf2d4becae` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:30.174861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99106baf4a0c420a90a6bbcf2d4becae)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:30.177453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:30.364111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99106baf4a0c420a90a6bbcf2d4becae', 'request_id': 'req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.379488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99106baf4a0c420a90a6bbcf2d4becae', 'request_id': 'req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.449278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:30.472759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99106baf4a0c420a90a6bbcf2d4becae', 'request_id': 'req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.490712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] The token cache is being invalidate because project 99106baf4a0c420a90a6bbcf2d4becae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:30.491397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.492704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.495743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 827/1654] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:30 2022] DELETE /identity/v3/projects/99106baf4a0c420a90a6bbcf2d4becae => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:30.500277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:30.516271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e3ad-3e9a-46e2-b7dd-8987c77fa59d service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:30.623636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:30.624555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:30.624892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:30.625172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] PATH_INFO: `/v3/users/8c52bae058e7494aa799e7de0e8beb78` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:30.626953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c52bae058e7494aa799e7de0e8beb78)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:30.630279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:30.662775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:30.935359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c52bae058e7494aa799e7de0e8beb78'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.936093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c52bae058e7494aa799e7de0e8beb78'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:30.980030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c52bae058e7494aa799e7de0e8beb78'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:31.065352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c52bae058e7494aa799e7de0e8beb78'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:31.084380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c52bae058e7494aa799e7de0e8beb78'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:31.103592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 828/1655] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:30 2022] DELETE /identity/v3/users/8c52bae058e7494aa799e7de0e8beb78 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:33.187888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:33.192372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:33.231061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e25a5f-1cf4-4bae-a276-d956cc4e10f4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:33.444725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:33.444725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:33.444725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:33.444725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] PATH_INFO: `/v3/users/2c1bb573a5b94e4ea64ab9775384fd91` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:33.449286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1bb573a5b94e4ea64ab9775384fd91)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:33.453238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:33.605080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:33.606813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:33.628270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057c78d-7d3e-430f-83e4-ecc358a14a5b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:33.642249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:33.642916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:33.643739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:33.644100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] PATH_INFO: `/v3/projects/5e0c511affc34ce1abb8f703185c73f6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:33.647320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0c511affc34ce1abb8f703185c73f6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:33.648408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:40:33.648408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 24 10:40:33.648408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: Aug 24 10:40:33.649885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:33.852561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1bb573a5b94e4ea64ab9775384fd91'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:33.857106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1bb573a5b94e4ea64ab9775384fd91'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:33.877260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1bb573a5b94e4ea64ab9775384fd91'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:33.886342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0c511affc34ce1abb8f703185c73f6', 'request_id': 'req-cc7e3479-9020-4976-bd0a-3c4d056e159b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:33.987967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1bb573a5b94e4ea64ab9775384fd91'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.008019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-883eb1c4-4e9f-4416-b5de-317fec45912d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1bb573a5b94e4ea64ab9775384fd91'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.016920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 828/1656] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:33 2022] DELETE /identity/v3/users/2c1bb573a5b94e4ea64ab9775384fd91 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:34.038649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.039089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.040226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.050106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0c511affc34ce1abb8f703185c73f6', 'request_id': 'req-cc7e3479-9020-4976-bd0a-3c4d056e159b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.069904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0c511affc34ce1abb8f703185c73f6', 'request_id': 'req-cc7e3479-9020-4976-bd0a-3c4d056e159b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.085402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] The token cache is being invalidate because project 5e0c511affc34ce1abb8f703185c73f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:34.085799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.086705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cc7e3479-9020-4976-bd0a-3c4d056e159b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:34.089031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 829/1657] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:33 2022] DELETE /identity/v3/projects/5e0c511affc34ce1abb8f703185c73f6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:34.093386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:34.093943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c6c9-7f7e-41ff-86bb-6a85f8a8907f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.094311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c6c9-7f7e-41ff-86bb-6a85f8a8907f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.094864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c6c9-7f7e-41ff-86bb-6a85f8a8907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.096029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:34.161405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d2f0c6c9-7f7e-41ff-86bb-6a85f8a8907f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:34.167424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d2f0c6c9-7f7e-41ff-86bb-6a85f8a8907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:34.248750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:34.331288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 829/1658] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:34.343986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:34.345565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:34.363503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 830/1659] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:34.372338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.372772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.373204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.424064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:34.425420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:34.450194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 831/1660] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:34.457882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:34.492677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a2cf3-c106-48a3-aa6e-ffdeb29b62a6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:34.501261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:34.503896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.504398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.504970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.509704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7268c-2033-495d-8372-1486591092d0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:34.530095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:34.530743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.531027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.531302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.532002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:34.532312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:34.537661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:34.539555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:34.558086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:34.566118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:34.585523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 830/1661] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:34.607715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 832/1662] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:34.612277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:34.640609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b63c1-3533-42b3-ab8c-1ae12d946643 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:34.660060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:34.660707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:34.660989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:34.661271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:34.661917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:34.671153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:34.840782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:34.841670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 831/1663] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:34 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:34.856880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2795-3b25-4df7-a422-9aa4f74eb163 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:35.064555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:35.066795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:35.067367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:35.067844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:35.069347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:35.071825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:35.253141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:35.255211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 833/1664] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:34 2022] POST /identity/v3/users => generated 284 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:35.282640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe068ada-7bee-4c95-adf2-f69330bc0973 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:35.297184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:35.298477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:35.298763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:35.299169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:35.312290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:35.319367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:35.361513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:35.372735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 832/1665] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:35.375451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563955-0921-4dba-ab84-db45e5ec5a42 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:35.383958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:35.383958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:35.383958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:35.383958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:35.384264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:35.385719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c034d-2567-4483-84e8-055898df4874 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:35.400560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 834/1666] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:35.402196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:35.422650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2144-5538-4f20-9b4b-0c8a74f0bdf1 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:35.437699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:35.439221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:35.439679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:35.440876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] PATH_INFO: `/v3/projects/ca649ed131114321863bfd148347b392/users/968032524aa54e3aa4d493d8b41861b5/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:35.490982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca649ed131114321863bfd148347b392, user_id=968032524aa54e3aa4d493d8b41861b5, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:35.498753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:35.588920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 833/1667] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:35 2022] PUT /identity/v3/projects/ca649ed131114321863bfd148347b392/users/968032524aa54e3aa4d493d8b41861b5/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:35.600910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:35.601200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:35.601462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:35.678607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] MFA Rules not processed for user `968032524aa54e3aa4d493d8b41861b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:35.679994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:35.881056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 835/1668] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:35.881405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:36.019501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01e00-5da1-4c08-95b2-75e19e1193a5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:36.032782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:36.033409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:36.034503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:36.034782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:36.035409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:36.039198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:36.239116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 834/1669] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:35 2022] POST /identity/v3/projects => generated 369 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:36.243990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:36.262561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4331c6-2140-4ae7-8458-6a420e8d4fa3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:36.503803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:36.505057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:36.505493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:36.506156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:36.510389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:36.510389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:36.673572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 836/1670] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:36 2022] POST /identity/v3/users => generated 291 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:36.678171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:36.697624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdf8c7-9e06-47ac-a974-e4a84ddd8655 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:36.715525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:36.716463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:36.716870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:36.717279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:36.718088 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:36.722684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:36.758132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 835/1671] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:36.762291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:36.780746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa706-bb18-4b94-8229-8727bf5567c8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:36.793121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:36.793806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:36.794089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:36.794363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] PATH_INFO: `/v3/projects/7a3d847bffba4744b928724b92b0f134/users/9e2bd6db20a64aa9875576a3af1b4998/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:36.801918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:36.804934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:36.820965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:36.836482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248272-e0eb-4174-a044-6f1658ba38b6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:36.845076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3d847bffba4744b928724b92b0f134, user_id=9e2bd6db20a64aa9875576a3af1b4998, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:36.846484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:36.848520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:36.851023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:36.851413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:36.852822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] PATH_INFO: `/v3/projects/6f0c590b7bac45f097c4269c216180a8` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:36.856276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0c590b7bac45f097c4269c216180a8)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:36.861611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:36.906734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:36.940617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 837/1672] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:36 2022] PUT /identity/v3/projects/7a3d847bffba4744b928724b92b0f134/users/9e2bd6db20a64aa9875576a3af1b4998/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:36.944305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:37.021345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0c590b7bac45f097c4269c216180a8', 'request_id': 'req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.042052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0c590b7bac45f097c4269c216180a8', 'request_id': 'req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.074420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a76c2f-954c-47ab-8104-7d39c16ae987 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:37.135659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0c590b7bac45f097c4269c216180a8', 'request_id': 'req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.161443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] The token cache is being invalidate because project 6f0c590b7bac45f097c4269c216180a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:37.161747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.166253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.168441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 836/1673] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:36 2022] DELETE /identity/v3/projects/6f0c590b7bac45f097c4269c216180a8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:37.173222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:37.177504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:37.182074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:37.182701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:37.182981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:37.186507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:37.189962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:37.197287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:37.215346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34dc-3fc2-48a0-9e92-0b4af6460e5b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:37.226426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 838/1674] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:37.230020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:37.239568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:37.240569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:37.241373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:37.241793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:37.243628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] PATH_INFO: `/v3/users/69eedd014f94488587c1812597850a02` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:37.245485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69eedd014f94488587c1812597850a02)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:37.257291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:37.296814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c596da-a8cd-4947-ab00-587282bb7bc6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:37.309050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:37.309967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:37.310386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:37.310792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] PATH_INFO: `/v3/projects/7a3d847bffba4744b928724b92b0f134/users/9e2bd6db20a64aa9875576a3af1b4998/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:37.317359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3d847bffba4744b928724b92b0f134, user_id=9e2bd6db20a64aa9875576a3af1b4998, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:37.320984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ddc0d-cd43-4624-9c33-e9ec8eabf69f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:37.356635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 839/1675] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:37 2022] PUT /identity/v3/projects/7a3d847bffba4744b928724b92b0f134/users/9e2bd6db20a64aa9875576a3af1b4998/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:37.374204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:37.374674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:37.375059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:37.436653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] MFA Rules not processed for user `9e2bd6db20a64aa9875576a3af1b4998`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:37.438029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:37.560969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69eedd014f94488587c1812597850a02'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.561737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69eedd014f94488587c1812597850a02'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.579251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69eedd014f94488587c1812597850a02'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.617057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 840/1676] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:37.633994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:37.638185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:37.678698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69eedd014f94488587c1812597850a02'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.707053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3090081e-6db9-4789-a6cf-19fe486342a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69eedd014f94488587c1812597850a02'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:37.722680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 837/1677] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:37 2022] DELETE /identity/v3/users/69eedd014f94488587c1812597850a02 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:37.824185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f16-2e29-4e7a-9b8a-d8f7730b46c0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:37.987692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:37.988280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:37.988778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:37.989057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:38.100565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:38.102192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbee1b0-52a9-4956-bf56-0948e8451a3c service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:38.115656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 841/1678] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:38.447516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fbf-ddfd-4a16-bb33-d685a270c39f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:38.447516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fbf-ddfd-4a16-bb33-d685a270c39f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:38.448604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512fbf-ddfd-4a16-bb33-d685a270c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:38.530422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ea512fbf-ddfd-4a16-bb33-d685a270c39f None None] MFA Rules not processed for user `806a6eb77a06442481ecc1a4004ee57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:38.531671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ea512fbf-ddfd-4a16-bb33-d685a270c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:38.652746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 838/1679] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:38.664215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fb52-0e76-4418-8372-539ae7dcce98 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:38.664514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fb52-0e76-4418-8372-539ae7dcce98 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:38.664776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fb52-0e76-4418-8372-539ae7dcce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:38.698139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e8a9fb52-0e76-4418-8372-539ae7dcce98 None None] MFA Rules not processed for user `806a6eb77a06442481ecc1a4004ee57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:38.699622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e8a9fb52-0e76-4418-8372-539ae7dcce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:38.725602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 842/1680] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:38.768603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d31af-4f34-479e-98b3-861e5eddf211 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:38.769443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d31af-4f34-479e-98b3-861e5eddf211 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:38.769871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d31af-4f34-479e-98b3-861e5eddf211 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:38.771391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 839/1681] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 24 10:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:38.786552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ddbd-1926-447d-b2fa-2ded79005a7d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:38.786880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ddbd-1926-447d-b2fa-2ded79005a7d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:38.787173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ddbd-1926-447d-b2fa-2ded79005a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:38.854680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7685ddbd-1926-447d-b2fa-2ded79005a7d None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:38.856538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7685ddbd-1926-447d-b2fa-2ded79005a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:38.963795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 843/1682] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 24 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:38.972973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d31af-4f34-479e-98b3-861e5eddf211 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:38.990654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d31af-4f34-479e-98b3-861e5eddf211 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:38.997918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:38.998758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:38.999202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:38.999760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:39.011639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:39.014025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa322f-14db-4b22-a686-56b7cfc91b96 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:39.037584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 840/1683] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:39.311801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:39.312134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:39.312452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:39.313903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 844/1684] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 24 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:39.319281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:39.319566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:39.319915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:39.339668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:39.340865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:39.350536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 841/1685] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:39.362948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:39.364734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:39.458195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259517-a00b-4d90-8db9-17678ec96afa None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:39.461966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:39.462575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:39.462851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:39.463120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:39.474496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:39.483395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f421c14-fc34-44ee-b060-eb8fa620e8a4 service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:39.487722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 845/1686] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:40:39.836376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:39.927527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:40.433978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:40.435594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:40.532864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2aa45-ceed-49c3-8fef-c0f23e9ac012 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.533147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2aa45-ceed-49c3-8fef-c0f23e9ac012 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.534259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2aa45-ceed-49c3-8fef-c0f23e9ac012 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:40.536914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 846/1687] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 24 10:40:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:40:40.542679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144be182-47bc-414b-ba7f-23de2c85d620 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.542963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144be182-47bc-414b-ba7f-23de2c85d620 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.543231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144be182-47bc-414b-ba7f-23de2c85d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:40.618309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-144be182-47bc-414b-ba7f-23de2c85d620 None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:40.621401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-144be182-47bc-414b-ba7f-23de2c85d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:40.638366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484350c1-d115-45c0-b44f-c250dc8de104 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:40.657612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:40.658321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.659177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.659461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] PATH_INFO: `/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:40.661914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caa9c9cd9624d049f49c56bf91e6f62)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:40.666654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:40.764063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 847/1688] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:40.764335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913366-98a4-431e-ae43-bb9b99b8a903 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.764778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913366-98a4-431e-ae43-bb9b99b8a903 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.765253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913366-98a4-431e-ae43-bb9b99b8a903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:40.823039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caa9c9cd9624d049f49c56bf91e6f62', 'request_id': 'req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:40.829101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f9913366-98a4-431e-ae43-bb9b99b8a903 None None] MFA Rules not processed for user `b51ab52dfba64392ad65d894c6dadb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:40.832846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f9913366-98a4-431e-ae43-bb9b99b8a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:40.837793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caa9c9cd9624d049f49c56bf91e6f62', 'request_id': 'req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:40.940506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 848/1689] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:40.951278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.951500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.951752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:40.952273 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caa9c9cd9624d049f49c56bf91e6f62', 'request_id': 'req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:40.968340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] The token cache is being invalidate because project 8caa9c9cd9624d049f49c56bf91e6f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:40.968832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:40.971741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9f69a5f4-b2b2-46d5-9d54-b2a8d2e47061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:40.976653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 842/1690] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:40 2022] DELETE /identity/v3/projects/8caa9c9cd9624d049f49c56bf91e6f62 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:40.982067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1d03-4ac9-4ed4-9b05-73ba8dde7172 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:40.984133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1d03-4ac9-4ed4-9b05-73ba8dde7172 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:40.984678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1d03-4ac9-4ed4-9b05-73ba8dde7172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.025269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] MFA Rules not processed for user `b51ab52dfba64392ad65d894c6dadb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:41.029529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b02c1d03-4ac9-4ed4-9b05-73ba8dde7172 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:41.030746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b02c1d03-4ac9-4ed4-9b05-73ba8dde7172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.032400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.054523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 849/1691] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:41.056035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:41.078645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.259695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 843/1692] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:41.264247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14457-33d1-4d74-8d6b-a059004562a3 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.265976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14457-33d1-4d74-8d6b-a059004562a3 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.266406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14457-33d1-4d74-8d6b-a059004562a3 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.277497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 844/1693] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 24 10:40:41 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:41.279246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.279529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.279811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.307973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3f4a0-dd15-4cf3-b4dd-13defc34c6e8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:41.322147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:41.325159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.325446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.326117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.340849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.347745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:41.356428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.362083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:41.364211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97cfc-4a3d-488b-9903-1a35e370539d service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:41.383461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 850/1694] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:41.384817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.385278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.385573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.395978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 845/1695] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:41.399232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:41.434581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47f52-f198-48fd-9059-39ca09f3bb99 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:41.436945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:41.438189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.454405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:41.454716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.462788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.463120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.463904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:41.464177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:41.477442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:41.527025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 846/1696] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:41.531698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:41.570161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3944a2-8489-46dd-adbf-2a275974608c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:41.586811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:41.587429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.588253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.588554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.589693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:41.592176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:41.658403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 851/1697] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 24 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:41.666550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:41.679772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a45749-0a86-4239-988a-8a7cf0fac577 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:41.687968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:41.689412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.690697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.691164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.694042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:41.712999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:41.715758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:41.740785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 852/1698] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:41.768703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 847/1699] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:41 2022] POST /identity/v3/projects => generated 391 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:41.773487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:41.791375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45aec6-7e8c-4839-8f84-7a832810ed4d service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:41.918742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:41.919515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:41.919718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:41.920084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:41.930519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:41.930519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:42.015982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 853/1700] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:41 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:42.024029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:42.036524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504df9-dcb7-4df1-bdcf-7c1edd48bd31 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:42.048600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:42.049929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.050170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.050495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.051208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:42.054733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:42.074395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 848/1701] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:42.078654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:42.101032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e7eea-ffce-4118-8fc5-2c3375def7ec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:42.118362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:42.118994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.119276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.119547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.120277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:42.121920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2013-0c40-461a-a8d7-67a3c004eef9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:42.140324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 854/1702] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:40:42.141479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:42.163025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1bbbb-41b6-4e0a-ba22-168f6c3f9118 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:42.185723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:42.187849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32dc2-0fae-4208-8884-c6ce22ca00d4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.191648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32dc2-0fae-4208-8884-c6ce22ca00d4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.191648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32dc2-0fae-4208-8884-c6ce22ca00d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.192505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.192792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.193064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] PATH_INFO: `/v3/projects/dc1fa025380148f298ccda940f641f52/users/761113a75a9d465586339cbd4289a790/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.278003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1fa025380148f298ccda940f641f52, user_id=761113a75a9d465586339cbd4289a790, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:42.281761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcead1e-7693-48ad-a4d9-1136cbf3b686 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:42.300232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9ed32dc2-0fae-4208-8884-c6ce22ca00d4 None None] MFA Rules not processed for user `7e35335d035c44daaf79627c255e9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:42.304560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9ed32dc2-0fae-4208-8884-c6ce22ca00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:42.391135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 849/1703] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:42 2022] PUT /identity/v3/projects/dc1fa025380148f298ccda940f641f52/users/761113a75a9d465586339cbd4289a790/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:42.392580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c91c3-e9ad-4586-9c13-a3a9250e0947 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.393402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c91c3-e9ad-4586-9c13-a3a9250e0947 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.393720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c91c3-e9ad-4586-9c13-a3a9250e0947 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.395106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 850/1704] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 24 10:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:40:42.396307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.396579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.396851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.524576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] MFA Rules not processed for user `761113a75a9d465586339cbd4289a790`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:42.526176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:42.613964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 855/1705] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:42.615582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2499-8dff-48b7-938a-e77756b6d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.625297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2499-8dff-48b7-938a-e77756b6d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.627252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2499-8dff-48b7-938a-e77756b6d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:42.706261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2a6f2499-8dff-48b7-938a-e77756b6d4e6 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:42.709833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2a6f2499-8dff-48b7-938a-e77756b6d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:42.775144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:42.838832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 851/1706] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:42.847950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:42.847950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:42.910489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 856/1707] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:42.912207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:42.912496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:42.912766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.016403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] MFA Rules not processed for user `caa000b3f2f242a7a1418c3a56bdc55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:43.017629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:43.059738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d48ff-c3be-4ea0-a04a-23c4ec3264ac None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.088507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.089169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.089448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.089930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.150751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 857/1708] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:43.151861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.258567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.262039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfd8d9-f46b-42e9-a989-8825798ebffc service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.276890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 852/1709] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:43.278600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.279104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.279588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.289409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 853/1710] 10.222.0.50 () {54 vars in 961 bytes} [Wed Aug 24 10:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:43.289409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.301822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:43.347019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2925659-b333-4e48-8b9e-3511b431fef4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.365498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.366208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.366815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.367207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.368086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.374581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.386188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:43.500296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0856c0d-a496-4553-90e0-01177c26cbf1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.507698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.508624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.509035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.509449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.529623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.529623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d4c0c-2dd3-4ee8-a94b-6da2c9823b5a service glance] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.545808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 854/1711] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:43.547471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.547972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.548331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.575926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:43.577259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:43.577737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 858/1712] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:43 2022] POST /identity/v3/projects => generated 391 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:43.579585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.735709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07902-7962-4872-81b6-2d2b30222fb6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.738435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 855/1713] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Aug 24 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:43.747757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.758705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:43.763705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.764649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.764812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebbcc-2b68-4156-acb3-79137ab44972 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.765252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.765751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.766676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.770253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.784244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.785462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.785709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.786032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.788832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:43.818195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.819911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.833939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 856/1714] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:40:43.874671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.917966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 859/1715] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:43 2022] POST /identity/v3/users => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:43.921821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:43.935685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e8ac-5ac1-4a2e-bb14-f24faea04e7d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:43.944351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:43.946515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:43.947050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:43.947469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:43.948991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:43.950957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:43.988810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 860/1716] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:43.990536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:44.024802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714154b-e1b8-4b67-ab8a-67decfae647c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:44.041079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:44.047757 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.048392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.050742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] PATH_INFO: `/v3/projects/f6b472d0209544f881cf5d31c48b1cc4/users/0ac3e4aabf1c40b6a38313e911773b9a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.126269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b472d0209544f881cf5d31c48b1cc4, user_id=0ac3e4aabf1c40b6a38313e911773b9a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:44.134116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:44.164683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630c9d-bc6c-42cf-8111-a1301612a6df service placement] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:44.173890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:44.179920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.179920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.179920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.231221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 861/1717] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:43 2022] PUT /identity/v3/projects/f6b472d0209544f881cf5d31c48b1cc4/users/0ac3e4aabf1c40b6a38313e911773b9a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:44.233192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:44.341213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:44.345423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85fc6d-3837-49fc-b571-53898e0a67fb service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:44.394874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 857/1718] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:44.428766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da0b65-ada6-4634-b58b-572a95b2a58e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:44.447215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:44.449994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.449994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.449994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.449994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:44.458685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:44.490523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c07e-db19-4281-84fc-97e6f2573c72 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.490760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c07e-db19-4281-84fc-97e6f2573c72 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.490936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c07e-db19-4281-84fc-97e6f2573c72 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.498694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 858/1719] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 24 10:40:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:44.509863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.510149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.510438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.520380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 862/1720] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:44.527753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:44.548146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddf4db-ce80-4ce9-902e-efa93755b4d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:44.552185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:44.553854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:44.567166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:44.569306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.570975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.571817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] PATH_INFO: `/v3/projects/f6b472d0209544f881cf5d31c48b1cc4/users/0ac3e4aabf1c40b6a38313e911773b9a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.578391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b472d0209544f881cf5d31c48b1cc4, user_id=0ac3e4aabf1c40b6a38313e911773b9a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:44.580588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c066cb6-24c8-4855-8ffd-4d18176b9665 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:44.592566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 863/1721] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:44 2022] PUT /identity/v3/projects/f6b472d0209544f881cf5d31c48b1cc4/users/0ac3e4aabf1c40b6a38313e911773b9a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:44.603454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.608075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.608075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.693655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 859/1722] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:44.746456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] MFA Rules not processed for user `0ac3e4aabf1c40b6a38313e911773b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:44.748000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:44.810915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:44.812752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:44.827567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad65bd-ef94-4e4c-8af8-eb5779ba014a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:44.860360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 864/1723] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:44.907331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:44.921135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:44.922281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:44.952114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:44.955008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:44.957023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:44.957537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:44.979323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:44.982569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:45.015349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 860/1724] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:40:45.098256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb9ccf-ccb0-4d13-a43d-53dd62efaa16 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:45.119637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:45.120312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:45.120586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:45.120858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:45.132547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:45.134288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:45.161224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 865/1725] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:45.412632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:45.412632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:45.431528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c44ec-a469-4584-a685-a0c8dccd16c8 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:45.438097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:45.439566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:45.440884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:45.441546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:45.557241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:45.558908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68123d-0415-4ebc-8472-40230dc653b1 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:45.576823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 861/1726] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:45.773668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:45.775283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:45.919366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:45.921019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269239-9153-409d-8eaa-146684e7bb21 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:45.926985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:45.928391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:45.928885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:45.929370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] PATH_INFO: `/v3/users/968032524aa54e3aa4d493d8b41861b5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:45.930812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968032524aa54e3aa4d493d8b41861b5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:45.933095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:46.181739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a058a-fcb0-4c7c-9fe5-00d5584386ad None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:46.182030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a058a-fcb0-4c7c-9fe5-00d5584386ad None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:46.182925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a058a-fcb0-4c7c-9fe5-00d5584386ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:46.261683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-664a058a-fcb0-4c7c-9fe5-00d5584386ad None None] MFA Rules not processed for user `b51ab52dfba64392ad65d894c6dadb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:46.262949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-664a058a-fcb0-4c7c-9fe5-00d5584386ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:46.264017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968032524aa54e3aa4d493d8b41861b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:46.265464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968032524aa54e3aa4d493d8b41861b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:46.321432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968032524aa54e3aa4d493d8b41861b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:46.374818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 862/1727] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:46.461135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968032524aa54e3aa4d493d8b41861b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:46.477325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968032524aa54e3aa4d493d8b41861b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:46.494124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 866/1728] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:45 2022] DELETE /identity/v3/users/968032524aa54e3aa4d493d8b41861b5 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:46.495611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:46.496132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:46.496227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:46.541260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:46.541845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:46.661694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 863/1729] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:46.829708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:46.832740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:46.930811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:47.023871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56fdd1-60ba-44be-8cce-917482f38617 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:47.038494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:47.047521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:47.048044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:47.048491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:47.082200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:47.091920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:47.098062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 867/1730] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:48.393977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:48.437754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:48.437754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:48.475059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718e44-217c-4af4-bab6-bc33187c959a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:48.482378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:48.483317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:48.484047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:48.484486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] PATH_INFO: `/v3/projects/ca649ed131114321863bfd148347b392` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:48.488853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca649ed131114321863bfd148347b392)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:48.491175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:48.698693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca649ed131114321863bfd148347b392', 'request_id': 'req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:48.710978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca649ed131114321863bfd148347b392', 'request_id': 'req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:48.815178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca649ed131114321863bfd148347b392', 'request_id': 'req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:48.834137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] The token cache is being invalidate because project ca649ed131114321863bfd148347b392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:48.837481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:48.842986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-3c9be5e3-7b0a-4a36-8f0e-7f2a8c38a54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:48.848861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 864/1731] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:48 2022] DELETE /identity/v3/projects/ca649ed131114321863bfd148347b392 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:48.850214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:48.900800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81806e-395c-4809-a477-d24d151407c6 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:49.087124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:49.088260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:49.088481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:49.088913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] PATH_INFO: `/v3/users/9e2bd6db20a64aa9875576a3af1b4998` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:49.090532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2bd6db20a64aa9875576a3af1b4998)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:49.096355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:49.239207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ef6b-08f7-4a77-a091-be8a3747b7f6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:49.240430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ef6b-08f7-4a77-a091-be8a3747b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:49.241037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ef6b-08f7-4a77-a091-be8a3747b7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:49.278864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7950ef6b-08f7-4a77-a091-be8a3747b7f6 None None] MFA Rules not processed for user `7e35335d035c44daaf79627c255e9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:49.280379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7950ef6b-08f7-4a77-a091-be8a3747b7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:49.410518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2bd6db20a64aa9875576a3af1b4998'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:49.411630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:49.412094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2bd6db20a64aa9875576a3af1b4998'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:49.420668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 865/1732] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:49.474255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2bd6db20a64aa9875576a3af1b4998'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:49.587247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2bd6db20a64aa9875576a3af1b4998'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:49.596806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8438f56c-ee61-45aa-bb1e-cb1d0b209e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2bd6db20a64aa9875576a3af1b4998'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:49.631464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 868/1733] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:48 2022] DELETE /identity/v3/users/9e2bd6db20a64aa9875576a3af1b4998 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:49.852538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:49.853599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:49.854029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:50.001073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:50.002465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:50.104435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:50.113367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:50.114286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:50.183092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] MFA Rules not processed for user `caa000b3f2f242a7a1418c3a56bdc55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:50.186632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:50.281890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 869/1734] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:50.318171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 866/1735] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:50.410436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:50.774096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:50.784649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:50.785123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:51.055000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856026b-7ae0-42a5-ac6c-9c3267702504 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:51.063696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:51.064452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:51.064788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:51.065277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:51.087452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:51.090500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38862c45-c529-4d8e-bcc4-e1bb03b73808 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:51.108592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 870/1736] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:40:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:40:51.358596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:51.360733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:51.544508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:51.623957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83706c3a-1890-4ca3-a098-8b855ce9e781 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:51.645432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:51.646522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:51.647038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:51.647511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] PATH_INFO: `/v3/projects/7a3d847bffba4744b928724b92b0f134` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:51.651465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3d847bffba4744b928724b92b0f134)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:51.653968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:51.952552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3d847bffba4744b928724b92b0f134', 'request_id': 'req-fd270ac9-74a3-48cb-968f-9225c9f307bd'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:51.970474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3d847bffba4744b928724b92b0f134', 'request_id': 'req-fd270ac9-74a3-48cb-968f-9225c9f307bd'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:52.071414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3d847bffba4744b928724b92b0f134', 'request_id': 'req-fd270ac9-74a3-48cb-968f-9225c9f307bd'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:52.101370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] The token cache is being invalidate because project 7a3d847bffba4744b928724b92b0f134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:52.104978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:52.108640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fd270ac9-74a3-48cb-968f-9225c9f307bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:52.125037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 867/1737] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:51 2022] DELETE /identity/v3/projects/7a3d847bffba4744b928724b92b0f134 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:52.125306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:52.125806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:52.125921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:52.197913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:52.199420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:52.450592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 871/1738] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:52.464370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:52.465496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:52.466564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:52.555964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:52.566228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:52.608357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 868/1739] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:52.613334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:52.621695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:52.629817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c6b80-4eb1-486c-8a02-0bfd9f946b9c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:52.645190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:52.646099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:52.647828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:52.648260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:52.649099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:40:52.651262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:52.654319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:52.678732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 872/1740] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:52.683271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:52.699571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817632a7-f6fd-4d01-be3a-8d978a4affa3 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:52.718375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:52.719044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:52.719325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:52.719738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:52.723197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:52.728929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:52.885838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 869/1741] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:40:52 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:40:52.895525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:52.910425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ab01a-b98d-44b7-8257-e4d5e086cfa1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:53.030292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:53.030906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.031358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.031811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.032602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:53.035404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af43a-80be-4a12-b9d1-fd380e642ae8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:53.149281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 873/1742] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:40:52 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:40:53.153038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:53.169695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d14fe-2802-43ee-8187-65908876ad4f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:53.181701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:53.195407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.195724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.196029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.196767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:53.205638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:53.224020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.224305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.224612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.330812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 870/1743] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:53.333956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:53.351441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:53.351441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:53.380856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c392b-81ce-45ed-ae34-a4447c258dd3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:53.414453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:53.415081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.415365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.415639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.416319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:53.417935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:53.486304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 871/1744] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:40:53.488809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:53.580566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e593-8d9d-4640-a90c-de9e413ee29f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:53.583674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 874/1745] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:53.585074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:53.586416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:53.608212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725a8f-e8cc-48ba-bc56-e30d34723672 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:53.612639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:53.613750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.614219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.614635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] PATH_INFO: `/v3/projects/c9260dcfdb184d52a940afe206c5905a/users/b63577f659cb49bf9dc7c1026e3b754d/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.652590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:53.652590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:53.652590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:53.652590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] PATH_INFO: `/v3/users/761113a75a9d465586339cbd4289a790` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:53.653355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] RBAC: Authorizing `identity:delete_user(user_id=761113a75a9d465586339cbd4289a790)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:53.653355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:53.676712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9260dcfdb184d52a940afe206c5905a, user_id=b63577f659cb49bf9dc7c1026e3b754d, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:53.683030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:53.835591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 872/1746] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:40:53 2022] PUT /identity/v3/projects/c9260dcfdb184d52a940afe206c5905a/users/b63577f659cb49bf9dc7c1026e3b754d/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:53.836854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:53.848453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:53.950282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761113a75a9d465586339cbd4289a790'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:53.958889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761113a75a9d465586339cbd4289a790'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:53.998642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761113a75a9d465586339cbd4289a790'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:54.118914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2a28-7a35-42a8-96ad-1983e152eb17 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:54.137327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:54.146174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:54.146174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:54.146174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:54.154393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:54.205842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761113a75a9d465586339cbd4289a790'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:54.208352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:54.209909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651caaa-5dfa-495e-8497-b1b7f547bc25 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:54.228356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c32c197-94b0-4ee9-abec-1fa838dc10da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761113a75a9d465586339cbd4289a790'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:54.257695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 873/1747] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:54.258960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:54.259334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:54.259502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:54.314154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 875/1748] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:53 2022] DELETE /identity/v3/users/761113a75a9d465586339cbd4289a790 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:54.321317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:54.323594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:54.324140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:54.412424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:54.415057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:54.417182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] MFA Rules not processed for user `b63577f659cb49bf9dc7c1026e3b754d`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:54.418831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:54.664905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 876/1749] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:54.725866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 874/1750] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:54.817522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:54.829169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:54.845251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:54.847700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:54.985021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:55.057499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52c36-1979-4f0a-88f0-def05410eb86 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:55.083156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:55.084062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:55.084550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:55.085622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:55.118993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924760f-1782-4ac0-87c3-7fcd1354ae2e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:55.129019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:55.136139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:55.136732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:55.137528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:55.140519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:55.142084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:55.208975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 877/1751] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:55.265084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:55.271423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff38084-2f93-4305-8700-5e97d8b7c5b7 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:55.278941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:55.280445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:55.314617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 875/1752] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:55.353921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229230-5097-4c1f-8035-ffe1ed9fa430 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:55.368329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:55.369436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:55.371366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:55.371954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] PATH_INFO: `/v3/users/b63577f659cb49bf9dc7c1026e3b754d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:55.374423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63577f659cb49bf9dc7c1026e3b754d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:55.379143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:55.855417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63577f659cb49bf9dc7c1026e3b754d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:55.860909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63577f659cb49bf9dc7c1026e3b754d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:55.935752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63577f659cb49bf9dc7c1026e3b754d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:56.069804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63577f659cb49bf9dc7c1026e3b754d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:56.078016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63577f659cb49bf9dc7c1026e3b754d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:56.093936 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 878/1753] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:55 2022] DELETE /identity/v3/users/b63577f659cb49bf9dc7c1026e3b754d => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:56.097213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27da15-d3d6-4ec3-9314-6db44991d525 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:56.097871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27da15-d3d6-4ec3-9314-6db44991d525 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:56.098224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27da15-d3d6-4ec3-9314-6db44991d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:56.160231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8d27da15-d3d6-4ec3-9314-6db44991d525 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:56.163209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8d27da15-d3d6-4ec3-9314-6db44991d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:56.318228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:56.530312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 876/1754] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:56.566172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:56.567852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:56.711005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187b08-1ac0-4092-b62f-a00a4cb06186 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:56.724592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:56.725364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:56.725647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:56.725922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:56.757962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:56.759353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa2b76-443b-4373-8401-5c490eaff432 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:56.800029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 879/1755] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:57.170192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.170754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.171092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.173462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 877/1756] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:40:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:57.248033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.248534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.248951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.335078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:57.335078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:57.620897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 880/1757] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:57.845048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:57.849028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:57.887197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12e0d-3e1c-491f-b184-f03c3f49d998 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:57.900052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:57.901262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.901767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.902354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.922456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:57.922456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:57.925462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:57.966456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 878/1758] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:58.875491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:58.877420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:58.899766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:58.901501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:59.008370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154efaa-3424-44f3-a4be-a762554f5191 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:59.009267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912b3a-341e-4a3c-b8ca-ceaf6db0df16 service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:59.009343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:59.009343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:59.009343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:59.009343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] PATH_INFO: `/v3/projects/c9260dcfdb184d52a940afe206c5905a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:59.009609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9260dcfdb184d52a940afe206c5905a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:59.009609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:59.009742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:59.009742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:59.009742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:59.009742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] PATH_INFO: `/v3/projects/dc1fa025380148f298ccda940f641f52` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:59.009997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1fa025380148f298ccda940f641f52)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:59.009997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:59.222875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1fa025380148f298ccda940f641f52', 'request_id': 'req-282fcdc1-713f-45cc-802b-3b684f88020d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.234076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1fa025380148f298ccda940f641f52', 'request_id': 'req-282fcdc1-713f-45cc-802b-3b684f88020d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.276243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9260dcfdb184d52a940afe206c5905a', 'request_id': 'req-263e5280-9595-4630-be25-e49763b44f0a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.438037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1fa025380148f298ccda940f641f52', 'request_id': 'req-282fcdc1-713f-45cc-802b-3b684f88020d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.480334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] The token cache is being invalidate because project dc1fa025380148f298ccda940f641f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:59.480954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.481744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.488171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 879/1759] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:58 2022] DELETE /identity/v3/projects/dc1fa025380148f298ccda940f641f52 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:40:59.492283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:59.494240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:59.495948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9260dcfdb184d52a940afe206c5905a', 'request_id': 'req-263e5280-9595-4630-be25-e49763b44f0a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.504765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9260dcfdb184d52a940afe206c5905a', 'request_id': 'req-263e5280-9595-4630-be25-e49763b44f0a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.551394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] The token cache is being invalidate because project c9260dcfdb184d52a940afe206c5905a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:40:59.556146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.561318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-263e5280-9595-4630-be25-e49763b44f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:40:59.570405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 881/1760] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:40:58 2022] DELETE /identity/v3/projects/c9260dcfdb184d52a940afe206c5905a => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:40:59.575403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce914-d382-4418-8e20-fb12e43bb3a7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:59.576194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce914-d382-4418-8e20-fb12e43bb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:59.576661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce914-d382-4418-8e20-fb12e43bb3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:59.621468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-473ce914-d382-4418-8e20-fb12e43bb3a7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:59.624029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-473ce914-d382-4418-8e20-fb12e43bb3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:59.804399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcdc1-713f-45cc-802b-3b684f88020d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:59.869359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 882/1761] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:40:59.871157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:59.871650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:59.872149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:59.950817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:59.960520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:59.976981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:59.978694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:59.985119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:59.985119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] PATH_INFO: `/v3/users/0ac3e4aabf1c40b6a38313e911773b9a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:59.989448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 883/1762] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:59.989598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac3e4aabf1c40b6a38313e911773b9a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:59.990989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:59.993041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:00.012229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a80fbf-dcf8-48a6-b300-5ef0928d16e2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:00.016132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:00.022845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:00.024304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:00.024938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:00.025766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] PATH_INFO: `/v3/users/52e784874ed242e9afbe15ea03ead0c4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:00.027607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e784874ed242e9afbe15ea03ead0c4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:00.031359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:00.509112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac3e4aabf1c40b6a38313e911773b9a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.520795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e784874ed242e9afbe15ea03ead0c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.523587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e784874ed242e9afbe15ea03ead0c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.524426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac3e4aabf1c40b6a38313e911773b9a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.549451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac3e4aabf1c40b6a38313e911773b9a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.575176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e784874ed242e9afbe15ea03ead0c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.698308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac3e4aabf1c40b6a38313e911773b9a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.732372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac3e4aabf1c40b6a38313e911773b9a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.756047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 880/1763] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:59 2022] DELETE /identity/v3/users/0ac3e4aabf1c40b6a38313e911773b9a => generated 0 bytes in 1258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:00.756047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:00.757166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:00.799359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e784874ed242e9afbe15ea03ead0c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.822704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d233a95f-4c15-443f-a07c-8e1c004e13be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e784874ed242e9afbe15ea03ead0c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:00.834243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 884/1764] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:40:59 2022] DELETE /identity/v3/users/52e784874ed242e9afbe15ea03ead0c4 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:00.838829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8755-5b84-4ea8-8e4d-6ea8e9d1a116 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:00.839157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8755-5b84-4ea8-8e4d-6ea8e9d1a116 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:00.839397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8755-5b84-4ea8-8e4d-6ea8e9d1a116 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:00.840822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 885/1765] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:41:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:00.849155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:00.849496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:00.902836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:00.903186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67616df-69bc-45d0-acfb-7c3ee661fbed admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:00.903279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:00.903279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:00.930147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:00.930883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:00.931153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:00.931732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:00.932589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:00.933040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:00.935097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c448-c435-4af9-baea-0817373088d8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:00.949306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 881/1766] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:00.950999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:00.951457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:00.952221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:00.971929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 886/1767] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:00.977793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:00.979652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:00.997087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec73f-de75-4e45-9915-91c377817cd1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:01.001576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:01.006305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:01.006821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:01.008378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:01.009353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:01.010212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:01.011771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:01.013952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:01.153679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 887/1768] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:00 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:01.154648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:01.159591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:01.229578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 882/1769] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:01.232185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:01.234631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:01.273014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2c902-f0d2-49c3-96ec-383a9b6710be None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:01.361369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7ed0-7435-4a79-a425-42b87a02b0be admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:01.371265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:01.373303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:01.374303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:01.374564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:01.456472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:01.461590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:01.463443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:01.465013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:01.466041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:01.477032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:01.632987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:01.637910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:01.674981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 888/1770] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:01.695190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:01.700210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:01.808468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 883/1771] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:01 2022] POST /identity/v3/users => generated 287 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:01.860471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872afdc-b822-46a1-856f-831c49882897 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:01.867268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:01.868207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:01.868512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:01.869177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:01.949248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:01.949248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:01.949248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 889/1772] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:01.960135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:01.980148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ed0-26db-4d86-9fa9-6fc1de5e271f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:01.986693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:01.987421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:01.987875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:01.988198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:01.989008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:01.991480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:02.013917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 884/1773] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:02.018447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:02.034977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878155b-486b-4ec2-b8ef-4108c25b9831 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:02.055540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:02.056458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:02.056744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:02.057195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:02.058672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:02.062341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3ffa8-2908-45e8-9859-21112582ddd6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:02.091972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 890/1774] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:02.093679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:02.104582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda6ed2-1fe5-457a-bcf9-d20598e2dcca admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:02.110478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:02.111898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:02.112180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:02.112497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] PATH_INFO: `/v3/projects/5061dfb7e16c4775b53591de64865b3c/users/931f31ed9d11470980aca9a5d15db2ec/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:02.140690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5061dfb7e16c4775b53591de64865b3c, user_id=931f31ed9d11470980aca9a5d15db2ec, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:02.144613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:02.337525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 885/1775] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:02 2022] PUT /identity/v3/projects/5061dfb7e16c4775b53591de64865b3c/users/931f31ed9d11470980aca9a5d15db2ec/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:02.350600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:02.350891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:02.351170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:02.401555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] MFA Rules not processed for user `931f31ed9d11470980aca9a5d15db2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:02.409834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:02.632734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:02.645194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 891/1776] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:02.784992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88c25-f733-4e65-833a-f969f710060e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:02.802116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:02.802756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:02.803036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:02.803309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:02.803968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:02.806180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:02.831637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:03.146240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 886/1777] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:02 2022] POST /identity/v3/projects => generated 373 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:03.148617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.191052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5e90c-cf38-4846-bb31-1b8883643f76 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:03.277342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:03.278108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.278378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.278741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.279400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:03.281501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:03.288523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.290859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:03.308888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85d341-b851-453a-8174-fbf881e8951c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:03.321111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:03.321111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.321111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.321111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] PATH_INFO: `/v3/projects/f6b472d0209544f881cf5d31c48b1cc4` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.321530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b472d0209544f881cf5d31c48b1cc4)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:03.334988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:03.492282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 892/1778] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:03 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:03.538716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.579708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f402-bdcf-4bc4-9970-e4e099a4b608 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:03.593597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:03.605406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.605406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.605406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.605406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:03.605406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:03.616991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 893/1779] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:03.618077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.637687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25062f0-73e0-4f76-b690-3478987dcee9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:03.646446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:03.647297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.648465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.649004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] PATH_INFO: `/v3/projects/7788874bcd4a40979c52087ee4336057/users/8e064b0423a94f25a76eea77244ec123/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.682246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7788874bcd4a40979c52087ee4336057, user_id=8e064b0423a94f25a76eea77244ec123, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:03.689999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:03.812300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 894/1780] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:03 2022] PUT /identity/v3/projects/7788874bcd4a40979c52087ee4336057/users/8e064b0423a94f25a76eea77244ec123/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:03.815289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.822342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:03.840747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b472d0209544f881cf5d31c48b1cc4', 'request_id': 'req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:03.858247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b472d0209544f881cf5d31c48b1cc4', 'request_id': 'req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:03.970242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b472d0209544f881cf5d31c48b1cc4', 'request_id': 'req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:03.971200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb45a-45b9-4e73-8e8a-40bfcfaddfc1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:04.006947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] The token cache is being invalidate because project f6b472d0209544f881cf5d31c48b1cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:04.006947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.006947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.006947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 887/1781] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:03 2022] DELETE /identity/v3/projects/f6b472d0209544f881cf5d31c48b1cc4 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:04.006947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:04.007442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:04.118916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:04.119635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.120158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.120277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] PATH_INFO: `/v3/projects/1f9186f4423c47d6b96e600f8b41d122` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.125012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9186f4423c47d6b96e600f8b41d122)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:04.130156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:04.195740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193500d-3b81-4a7e-ae10-0b727ad7fc9d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:04.203057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:04.204693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.204693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.205320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.206474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:04.208571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c813bf-8376-465c-bc82-b190e391a36e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:04.223275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 888/1782] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:04.225407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.225845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.226251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.253059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:04.254737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:04.266243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 889/1783] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:04.269039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:04.294996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecbf5e-1c21-460b-b715-5a67a10c838b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:04.320717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9186f4423c47d6b96e600f8b41d122', 'request_id': 'req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.386911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:04.421859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9186f4423c47d6b96e600f8b41d122', 'request_id': 'req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.431633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9186f4423c47d6b96e600f8b41d122', 'request_id': 'req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.456828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:04.457928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.458399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.458857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] PATH_INFO: `/v3/projects/7788874bcd4a40979c52087ee4336057/users/8e064b0423a94f25a76eea77244ec123/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.461171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7788874bcd4a40979c52087ee4336057, user_id=8e064b0423a94f25a76eea77244ec123, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:04.464051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:04.465730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] The token cache is being invalidate because project 1f9186f4423c47d6b96e600f8b41d122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:04.466267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.467519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d3cf72ab-09d7-4fea-a261-a5e0a369a91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.469968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 895/1784] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:03 2022] DELETE /identity/v3/projects/1f9186f4423c47d6b96e600f8b41d122 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:04.473193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519501-135c-449d-8c02-9b7c31d5129b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.473747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519501-135c-449d-8c02-9b7c31d5129b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.474124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519501-135c-449d-8c02-9b7c31d5129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.499526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 890/1785] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:04 2022] PUT /identity/v3/projects/7788874bcd4a40979c52087ee4336057/users/8e064b0423a94f25a76eea77244ec123/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:04.506636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:04.506636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:04.507010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8c519501-135c-449d-8c02-9b7c31d5129b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:04.508770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8c519501-135c-449d-8c02-9b7c31d5129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:04.607069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 896/1786] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:04.607069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.607069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.607069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.627831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb85cf-56c0-4d9a-92b9-be01543d4a4c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:04.647089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:04.648139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.648633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.649692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] PATH_INFO: `/v3/users/f9b429544eb04e79be9f13cc62c4dd21` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.651937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b429544eb04e79be9f13cc62c4dd21)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:04.657876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:04.671949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] MFA Rules not processed for user `8e064b0423a94f25a76eea77244ec123`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:04.672259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:04.868181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 897/1787] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:04.869353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:04.893310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdab2e-e842-4e7b-8d5b-8cda1fdf6706 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:04.905931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:04.906637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:04.906925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:04.907351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:04.908309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:04.908482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:04.931216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:04.938086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b429544eb04e79be9f13cc62c4dd21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.940569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b429544eb04e79be9f13cc62c4dd21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.956743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b429544eb04e79be9f13cc62c4dd21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:04.980541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 898/1788] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:04.981407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:04.994593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:05.071739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b429544eb04e79be9f13cc62c4dd21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:05.095082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b429544eb04e79be9f13cc62c4dd21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:05.110208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 891/1789] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:04 2022] DELETE /identity/v3/users/f9b429544eb04e79be9f13cc62c4dd21 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:05.110850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:05.117840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:05.132023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231dc1d-cdcf-412c-ac33-b4e1aa2d0eae admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:05.216815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:05.217726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:05.218308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:05.218733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:05.222210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:05.277750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae47ff-555c-41d0-9884-55e5cdda5cb4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:05.287000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:05.289621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:05.289621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:05.289621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:05.289870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:05.293885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:05.316988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:05.318819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:05.329630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 899/1790] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:05.501311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 892/1791] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:05.505788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:05.523338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24430b9-9207-4b78-b523-4e308e34f920 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:05.659538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:05.659538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:05.678596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:05.678596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:05.678596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:05.678984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:05.911203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 900/1792] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:05 2022] POST /identity/v3/users => generated 289 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:05.915724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:05.925210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:05.935149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edf5c-c017-4b20-ba64-7e7c25cc9321 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:05.940980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:05.941726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:05.942163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:05.942745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:05.943944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:05.947638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:05.968969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 893/1793] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:05.973892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:05.990533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8baee-2c1e-440e-a6a7-3c8aeb8598ad admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:06.031247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:06.031848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.032295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.032583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.033343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:06.035193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15782987-bfa8-41c2-a1ae-944ae2757678 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:06.056183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 901/1794] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:06.057657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:06.077878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c1ca-bd3d-4b90-a90e-e28dc3dc9219 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:06.087565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:06.089220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.089765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.090251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] PATH_INFO: `/v3/projects/619a89829ed9499a859f6ad0ddf3ae38/users/87e87b65ea2c4216947bae21fa10e688/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.154237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619a89829ed9499a859f6ad0ddf3ae38, user_id=87e87b65ea2c4216947bae21fa10e688, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:06.165575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:06.334308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.334964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.334964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.337934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 894/1795] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:06 2022] PUT /identity/v3/projects/619a89829ed9499a859f6ad0ddf3ae38/users/87e87b65ea2c4216947bae21fa10e688/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:06.349389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:06.354188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:06.410101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] MFA Rules not processed for user `87e87b65ea2c4216947bae21fa10e688`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:06.414018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:06.475162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec7f3-0436-4852-8eb5-eac4da1b2b25 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:06.480852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:06.481776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.482108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.482456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] PATH_INFO: `/v3/projects/2228405bbe2f4005996fdda06a8d7116` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.483914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2228405bbe2f4005996fdda06a8d7116)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:06.487014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:06.523519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 902/1796] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:06.529392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:06.547475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aab02-0543-49b5-926c-3b47af38a7a4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:06.557491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:06.558311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.558591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.558863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.559714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:06.562097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:06.779059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 903/1797] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:06 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:06.779059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:06.788105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2228405bbe2f4005996fdda06a8d7116', 'request_id': 'req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:06.799595 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2228405bbe2f4005996fdda06a8d7116', 'request_id': 'req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:06.901926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca795fa-9e6d-40bd-b1ab-3b14f369e964 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:06.913737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:06.913737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.913737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.913737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.914268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:06.914268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:06.932636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2228405bbe2f4005996fdda06a8d7116', 'request_id': 'req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:06.946156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] The token cache is being invalidate because project 2228405bbe2f4005996fdda06a8d7116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:06.946377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:06.947080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d7a21c43-d0d4-4aa5-9350-43e2a3a324d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:06.949416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 895/1798] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:06 2022] DELETE /identity/v3/projects/2228405bbe2f4005996fdda06a8d7116 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:06.954052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5af5-ef24-4ee4-87fd-b6d224bdecb9 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.954333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5af5-ef24-4ee4-87fd-b6d224bdecb9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.954603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5af5-ef24-4ee4-87fd-b6d224bdecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:06.977281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-bb6b5af5-ef24-4ee4-87fd-b6d224bdecb9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:06.978488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bb6b5af5-ef24-4ee4-87fd-b6d224bdecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:06.986670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 896/1799] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:06.995511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:06.995808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:06.996099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.019805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:07.021162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:07.030772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 904/1800] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:06 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:07.038860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 897/1801] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:07.039137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.040105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:07.040379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.054465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba2e7-96ec-4252-8786-e2c8be425f63 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.056326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d029ee-6999-4108-81a6-cfe04fec7cc4 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.062146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.062814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.063098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.063373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.064109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.066276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.067060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.067183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.067183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.068527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.068874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:07.069202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.071237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.084021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 905/1802] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:07.085358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.086509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 898/1803] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:07.093659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.096057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa084c43-a324-44e7-8692-67c8ed2b9665 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.101519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.102237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.102464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.102734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.103373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.104041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b6f4e-6424-4764-ab92-1528e745bd7a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.105007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.109140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.113544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.113544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.113544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.113544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.113544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.116239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 906/1804] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:07.120439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.131230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d4389-464b-42c1-bbc2-6b8f58b7ed87 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.137129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.142286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.142286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.142286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] PATH_INFO: `/v3/projects/3b53e827b7a7498fae2024f29e5adbbe/users/2cabd630aed34906bc69322bda99a014/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.153568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b53e827b7a7498fae2024f29e5adbbe, user_id=2cabd630aed34906bc69322bda99a014, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.156328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20440209-07d6-47b4-a784-6bc72a0a2084 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.209031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 899/1805] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:07.213404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.237268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 907/1806] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:07 2022] PUT /identity/v3/projects/3b53e827b7a7498fae2024f29e5adbbe/users/2cabd630aed34906bc69322bda99a014/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:07.250907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.251216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.251458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.280176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89eb5-8635-44c5-ac39-3f1cbdd5f372 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.282844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] MFA Rules not processed for user `2cabd630aed34906bc69322bda99a014`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:07.284301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:07.357545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.358187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.358587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.358866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.359500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.362053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.370946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 908/1807] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:07.375414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.386741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba72f-ac58-4452-9e8a-8ff048efb395 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.391344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.392820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.392820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.392820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.393416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.395321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.475819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 900/1808] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:07.476985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.484355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 909/1809] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:07.489500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.493622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61dbe3-7dbf-4e56-9066-8b3ee2ee1acd admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.562148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bff308-8320-49ca-bb9f-76fcaf76170b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.568613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.569476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.569902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.570317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.571105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.573798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.590613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.593150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.593150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.593150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.593150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.594293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.605566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 901/1810] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:07.609438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.621866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db662e9-5a22-4489-986c-d6057e666507 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.628190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.628813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.629098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.630150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.630897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.633890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.647323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 902/1811] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:07.651511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.663140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6b37a-9a82-43e3-88d5-f266bc61e839 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.667776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.668480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.668760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.669033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] PATH_INFO: `/v3/projects/00333118c91e4186b1df62100cf52eba/users/e657c01e09d04e7a8fece13788240e12/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.685753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00333118c91e4186b1df62100cf52eba, user_id=e657c01e09d04e7a8fece13788240e12, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.688908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce73b7d-5287-4a0f-bc78-3ec0a7a7bf22 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.716351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 910/1812] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:07.717639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.735762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1959ae-eb5a-41b5-9b8e-eae7ae5dfb94 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.735762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.735762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.735762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.737166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.737166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.738740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.750242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 911/1813] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:07.756239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.767106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5237d2f-6de4-42ba-8e90-c356fe4147ef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:07.772959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:07.773704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.774059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.774404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] PATH_INFO: `/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e/users/7b8c357a392a4e4ab1b27dab5c3b9641/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.790612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c6dbd1fd8b4028a19deeba71c73a9e, user_id=7b8c357a392a4e4ab1b27dab5c3b9641, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:07.793628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:07.815375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 903/1814] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:07 2022] PUT /identity/v3/projects/00333118c91e4186b1df62100cf52eba/users/e657c01e09d04e7a8fece13788240e12/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:07.825512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:07.825782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:07.826060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:07.859298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] MFA Rules not processed for user `e657c01e09d04e7a8fece13788240e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:07.860670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:07.909212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 912/1815] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:07 2022] PUT /identity/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e/users/7b8c357a392a4e4ab1b27dab5c3b9641/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:07.913618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:07.941145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 904/1816] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:07.946127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.002588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06cb8-c7c6-4b67-8e10-7ed676d7694b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.010394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.012985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.012985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.012985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.012985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.014588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.022249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e019b1b-dadc-4cc6-acc8-f84a56fad753 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.026999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.027685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.028063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.028404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.029090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 913/1817] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:08.029216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.031039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.033712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.044203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274501b7-54ec-48b8-9724-3474994c4e7e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.051087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.051878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.052161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.052432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] PATH_INFO: `/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e/users/7b8c357a392a4e4ab1b27dab5c3b9641/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.054544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c6dbd1fd8b4028a19deeba71c73a9e, user_id=7b8c357a392a4e4ab1b27dab5c3b9641, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.057262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164e88d-1e4a-4934-8d28-b84dbb4b7c12 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.068474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 914/1818] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:08 2022] PUT /identity/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e/users/7b8c357a392a4e4ab1b27dab5c3b9641/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:08.080811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.081740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.081740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.113388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] MFA Rules not processed for user `7b8c357a392a4e4ab1b27dab5c3b9641`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:08.114701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:08.128444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 905/1819] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:07 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:08.130875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.202937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 915/1820] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:08.207838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac32eb-7690-4800-bd4a-f8890538ed09 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.213276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.213952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.217822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.217822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.217822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.217822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.218118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.221134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:08.279442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83cc0-10f4-4c8b-87ba-dc6728da9cf2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.343723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 906/1821] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:08 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:08.344897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.358894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.358894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.358894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.358894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.359475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35241-7018-4158-ae21-26b4754f833a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.366171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.366790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.367065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.367337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.368010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.369606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.383061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 907/1822] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:08.393333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.407949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431eec-67fb-4af0-8e69-08aaf32f1013 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.413745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.414623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.414900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.415200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] PATH_INFO: `/v3/projects/ecf9966c91294e47860514d68f91c0d6/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.432443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9966c91294e47860514d68f91c0d6, user_id=786eaa1cfbab4cc8a0ce59f0e1c6f4f5, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.435201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.436303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.438727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.448663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 916/1823] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:08.556003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 908/1824] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:08 2022] PUT /identity/v3/projects/ecf9966c91294e47860514d68f91c0d6/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:08.560958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.570388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.576031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902c7-1fd0-4e31-9a7a-dfb389df0e0a service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.625589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf8836-40e3-481e-b0a8-636154d94b4f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.630278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.630934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.631245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.631627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.632433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.633024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.633299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.633568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.633661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:08.634254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.635951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.646570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 917/1825] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:08.650713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.664633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f167-f1ff-4178-bbf6-f72866265a32 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.667983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.668637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.668915 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.669184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] PATH_INFO: `/v3/projects/ecf9966c91294e47860514d68f91c0d6/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.671383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9966c91294e47860514d68f91c0d6, user_id=786eaa1cfbab4cc8a0ce59f0e1c6f4f5, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.674623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062326d-aa1e-4d1c-8240-bfe15a7516f2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.695885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 918/1826] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:08 2022] PUT /identity/v3/projects/ecf9966c91294e47860514d68f91c0d6/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:08.702604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.703025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.703546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.718436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.724603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.738896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 909/1827] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:08.742739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] MFA Rules not processed for user `786eaa1cfbab4cc8a0ce59f0e1c6f4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:08.744078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:08.839105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 919/1828] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:08.852826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:08.854260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:08.865703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d01a8-12a3-4671-b16d-82c6fa6a4fc7 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:08.916374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:08.916980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.917252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.917514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.929809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:08.931546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:08.942564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 910/1829] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:09.109175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:09.119569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff745e5-3e1f-4f11-b524-c9b3b7179f30 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:09.123148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:09.123745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:09.124062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:09.124328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:09.183535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:09.185082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6b36-8e30-499f-a921-5dfffdbe63f2 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:09.195184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 920/1830] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:09.201071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:09.698816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:09.700909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:09.783654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61ef5-b0e8-40d1-9c82-1217aff4d109 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:09.790955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:09.790955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:09.790955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:09.790955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] PATH_INFO: `/v3/users/931f31ed9d11470980aca9a5d15db2ec` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:09.791323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=931f31ed9d11470980aca9a5d15db2ec)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:09.792499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:10.089387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931f31ed9d11470980aca9a5d15db2ec'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:10.090372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931f31ed9d11470980aca9a5d15db2ec'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:10.104010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931f31ed9d11470980aca9a5d15db2ec'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:10.225552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931f31ed9d11470980aca9a5d15db2ec'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:10.240216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931f31ed9d11470980aca9a5d15db2ec'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:10.246530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 911/1831] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:09 2022] DELETE /identity/v3/users/931f31ed9d11470980aca9a5d15db2ec => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:10.251195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:10.252305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:10.252305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:10.273069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:10.274303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:10.335045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 921/1832] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:10.346574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:10.349570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:10.405627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a41d0c-46bb-42fc-9cbb-4ea42afe9f8e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:10.409928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:10.410534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:10.410811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:10.411082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:10.420455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:10.421963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:10.436117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 912/1833] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:10.452869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:10.963715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:10.966524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:10.989119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a74e9-f9d1-4747-9ebb-3b1bbe6e62f2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:11.001688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:11.002798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:11.003083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:11.003402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] PATH_INFO: `/v3/projects/5061dfb7e16c4775b53591de64865b3c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:11.005241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5061dfb7e16c4775b53591de64865b3c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:11.007162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:11.135712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5061dfb7e16c4775b53591de64865b3c', 'request_id': 'req-a7baece8-da52-4b21-92e3-7eb319e0865c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.209425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5061dfb7e16c4775b53591de64865b3c', 'request_id': 'req-a7baece8-da52-4b21-92e3-7eb319e0865c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.216973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5061dfb7e16c4775b53591de64865b3c', 'request_id': 'req-a7baece8-da52-4b21-92e3-7eb319e0865c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.228055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] The token cache is being invalidate because project 5061dfb7e16c4775b53591de64865b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:11.228341 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.228982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.230595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 922/1834] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:10 2022] DELETE /identity/v3/projects/5061dfb7e16c4775b53591de64865b3c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:11.234639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:11.247984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6d516-32f7-4638-9314-7fcab868c26a service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:11.320188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:11.321070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:11.321555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:11.322013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] PATH_INFO: `/v3/users/8e064b0423a94f25a76eea77244ec123` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:11.323701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e064b0423a94f25a76eea77244ec123)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:11.325883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:11.594909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e064b0423a94f25a76eea77244ec123'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.596141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e064b0423a94f25a76eea77244ec123'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.603736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e064b0423a94f25a76eea77244ec123'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.614754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:11.669428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e064b0423a94f25a76eea77244ec123'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.682457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b3d1bf70-9f94-4c89-a6e1-2a6304b630e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e064b0423a94f25a76eea77244ec123'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:11.688701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 913/1835] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:11 2022] DELETE /identity/v3/users/8e064b0423a94f25a76eea77244ec123 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:12.183804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:12.185271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:12.199083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baece8-da52-4b21-92e3-7eb319e0865c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:12.258360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:12.258999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.262394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.262394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] PATH_INFO: `/v3/projects/7788874bcd4a40979c52087ee4336057` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.262394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7788874bcd4a40979c52087ee4336057)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:12.263627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:12.380719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7788874bcd4a40979c52087ee4336057', 'request_id': 'req-5fc59845-7dad-4d03-ba28-69fcc3d60486'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:12.465834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7788874bcd4a40979c52087ee4336057', 'request_id': 'req-5fc59845-7dad-4d03-ba28-69fcc3d60486'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:12.473334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7788874bcd4a40979c52087ee4336057', 'request_id': 'req-5fc59845-7dad-4d03-ba28-69fcc3d60486'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:12.483882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] The token cache is being invalidate because project 7788874bcd4a40979c52087ee4336057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:12.484169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:12.484960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5fc59845-7dad-4d03-ba28-69fcc3d60486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:12.487307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 923/1836] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:12 2022] DELETE /identity/v3/projects/7788874bcd4a40979c52087ee4336057 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:12.492347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.492796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.492982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.513510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:12.514727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:12.601180 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 914/1837] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:12.609353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.610015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.610287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.641449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:12.643408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:12.655018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 924/1838] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:12.659812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:12.671678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e164cff-5d06-43c7-8ab8-c962fa1067f2 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:12.676993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:12.677835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.678733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.679150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.680010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:12.680450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:12.682531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:12.699863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 915/1839] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:12.705489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:12.717394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98567e-71ec-4758-b927-3688287c43b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:12.726345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:12.727029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.727314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.727594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.728781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:12.730734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:12.744335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:12.869941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 925/1840] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:12 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:12.870902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:12.886059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb5ec-b869-46f3-9e74-113f01602884 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:12.965873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:12.966482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:12.966764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:12.967073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:12.967750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:12.969676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.066613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 916/1841] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:12 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:13.070827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.081443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836aeef-c903-40c2-9ece-278d240f9c9b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:13.085930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:13.086516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.086793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.087177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.087742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:13.089344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.101011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 926/1842] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:13.105133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.116184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33dfc-796b-4379-ac3e-36cc4c30079e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:13.120875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:13.121462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.121739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.122011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.122654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:13.124329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513f6d-d7c5-4f9f-abe8-262ce7020f88 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.136090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 917/1843] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:13.145886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.156344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a51c-45e6-401d-bd37-f8e84ca0aa81 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:13.162186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:13.164177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.164177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.164177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] PATH_INFO: `/v3/projects/124f0b3af2684a7cad46b92f35869d38/users/f97dbba7a19240c582f8e24f48cb0c9f/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.182613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124f0b3af2684a7cad46b92f35869d38, user_id=f97dbba7a19240c582f8e24f48cb0c9f, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:13.185585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.255333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 927/1844] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:13 2022] PUT /identity/v3/projects/124f0b3af2684a7cad46b92f35869d38/users/f97dbba7a19240c582f8e24f48cb0c9f/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:13.266428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.266806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.267091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.304028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] MFA Rules not processed for user `f97dbba7a19240c582f8e24f48cb0c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:13.305268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:13.378863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.380534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:13.385503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 918/1845] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:13.397408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.398838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:13.454030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a0c6-85f0-4392-a0f8-785c1bd3f5c5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:13.460611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:13.461015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997104-a3e7-4405-919d-634addf45e7e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:13.461633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.462061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.462481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] PATH_INFO: `/v3/users/87e87b65ea2c4216947bae21fa10e688` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.463866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e87b65ea2c4216947bae21fa10e688)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:13.464784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:13.465392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.465667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.465768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.465940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.475873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:13.477306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91061-c07c-4807-8be0-c35993d97f37 service glance] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:13.487841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 919/1846] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:13.675645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e87b65ea2c4216947bae21fa10e688'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:13.677850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e87b65ea2c4216947bae21fa10e688'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:13.693323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e87b65ea2c4216947bae21fa10e688'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:13.772031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e87b65ea2c4216947bae21fa10e688'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:13.793374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e87b65ea2c4216947bae21fa10e688'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:13.808177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 928/1847] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:13 2022] DELETE /identity/v3/users/87e87b65ea2c4216947bae21fa10e688 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:13.809815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57349a61-d2db-4ad1-be00-71da5d450e31 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:13.810275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57349a61-d2db-4ad1-be00-71da5d450e31 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:13.811241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57349a61-d2db-4ad1-be00-71da5d450e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:13.847374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-57349a61-d2db-4ad1-be00-71da5d450e31 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:13.847374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-57349a61-d2db-4ad1-be00-71da5d450e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:13.945949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 920/1848] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:13.958011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:13.960050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.064511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d209f14-70f0-42cd-b031-cfc59475de23 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.079138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.081321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.081812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.082312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.086011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355edc-a9e6-4621-9c1a-f2ab5f9c4853 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.086304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355edc-a9e6-4621-9c1a-f2ab5f9c4853 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.086580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355edc-a9e6-4621-9c1a-f2ab5f9c4853 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.088256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 921/1849] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:41:14.095433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.096995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:14.106233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.106576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.106900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.129574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 929/1850] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:14.134953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:14.136783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.263665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 922/1851] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:14.306922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:14.312375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.332073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5be18-6210-4880-9c7a-02589108e388 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.338127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.338802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.339086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.339361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.349188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.350796 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:14.362673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 930/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:14.873272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:14.874695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.912330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37215da-16a0-4fd9-a03a-8945c4af4c4e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.924334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.931883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.931883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.931883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] PATH_INFO: `/v3/projects/619a89829ed9499a859f6ad0ddf3ae38` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.937496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619a89829ed9499a859f6ad0ddf3ae38)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.940476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:14.951747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:15.135357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619a89829ed9499a859f6ad0ddf3ae38', 'request_id': 'req-16792e24-f972-477e-aee2-5e0cb0ed74d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.142807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619a89829ed9499a859f6ad0ddf3ae38', 'request_id': 'req-16792e24-f972-477e-aee2-5e0cb0ed74d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.235518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619a89829ed9499a859f6ad0ddf3ae38', 'request_id': 'req-16792e24-f972-477e-aee2-5e0cb0ed74d4'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.261911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] The token cache is being invalidate because project 619a89829ed9499a859f6ad0ddf3ae38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:15.262688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.263444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.268967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 923/1853] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:14 2022] DELETE /identity/v3/projects/619a89829ed9499a859f6ad0ddf3ae38 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:15.272960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.308758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d9c8-e065-4f66-a898-e1846a03992b service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:15.391524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:15.392863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:15.393452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:15.393726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] PATH_INFO: `/v3/users/2cabd630aed34906bc69322bda99a014` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:15.394879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cabd630aed34906bc69322bda99a014)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:15.396971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:15.579010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cabd630aed34906bc69322bda99a014'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.579762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cabd630aed34906bc69322bda99a014'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.593792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cabd630aed34906bc69322bda99a014'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.666008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cabd630aed34906bc69322bda99a014'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.676171 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3ecd5cd6-3b5b-4c92-b326-19ea64a2a67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cabd630aed34906bc69322bda99a014'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:15.687346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 931/1854] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:15 2022] DELETE /identity/v3/users/2cabd630aed34906bc69322bda99a014 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:15.917394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:15.918861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:15.937940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16792e24-f972-477e-aee2-5e0cb0ed74d4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:16.019611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:16.020398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.020790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.021505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] PATH_INFO: `/v3/users/e657c01e09d04e7a8fece13788240e12` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.022748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e657c01e09d04e7a8fece13788240e12)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:16.024815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:16.325382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e657c01e09d04e7a8fece13788240e12'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.325382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e657c01e09d04e7a8fece13788240e12'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.325382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e657c01e09d04e7a8fece13788240e12'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.368588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:16.390081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e657c01e09d04e7a8fece13788240e12'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.403975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e657c01e09d04e7a8fece13788240e12'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.411755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 924/1855] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:15 2022] DELETE /identity/v3/users/e657c01e09d04e7a8fece13788240e12 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:16.416938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.417432 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.417802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.461208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:16.462978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.506038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:16.511541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.566713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 932/1856] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:16.578907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:16.584065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.637635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481f90c-cd75-4c95-9f66-76c5b3c72b9e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:16.649341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:16.650006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.653480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.653480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] PATH_INFO: `/v3/projects/3b53e827b7a7498fae2024f29e5adbbe` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.653480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b53e827b7a7498fae2024f29e5adbbe)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:16.654695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:16.669370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be6e8-bc5f-4141-b38d-4909604f457c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:16.693860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:16.694926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.695387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.696207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.709894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:16.711468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:16.729249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 933/1857] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:16.808447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b53e827b7a7498fae2024f29e5adbbe', 'request_id': 'req-21da6616-e912-43ae-8b86-0b7c2a9b3db9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.809478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b53e827b7a7498fae2024f29e5adbbe', 'request_id': 'req-21da6616-e912-43ae-8b86-0b7c2a9b3db9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.901896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b53e827b7a7498fae2024f29e5adbbe', 'request_id': 'req-21da6616-e912-43ae-8b86-0b7c2a9b3db9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.941692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] The token cache is being invalidate because project 3b53e827b7a7498fae2024f29e5adbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:16.948117 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.951754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:16.957730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 925/1858] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:16 2022] DELETE /identity/v3/projects/3b53e827b7a7498fae2024f29e5adbbe => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:16.961781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:16.972685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8640a3-0736-483f-8bf1-e3f8031819b5 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:17.058734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:17.059480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.059983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.060327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] PATH_INFO: `/v3/users/7b8c357a392a4e4ab1b27dab5c3b9641` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.061541 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8c357a392a4e4ab1b27dab5c3b9641)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:17.063545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:17.291278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8c357a392a4e4ab1b27dab5c3b9641'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.292226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8c357a392a4e4ab1b27dab5c3b9641'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.325513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8c357a392a4e4ab1b27dab5c3b9641'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.403351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8c357a392a4e4ab1b27dab5c3b9641'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.416426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:17.417337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8c357a392a4e4ab1b27dab5c3b9641'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.420080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.425226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 934/1859] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:16 2022] DELETE /identity/v3/users/7b8c357a392a4e4ab1b27dab5c3b9641 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:17.462740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6616-e912-43ae-8b86-0b7c2a9b3db9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:17.554135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:17.554771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.555052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.555308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] PATH_INFO: `/v3/projects/00333118c91e4186b1df62100cf52eba` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.556609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00333118c91e4186b1df62100cf52eba)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:17.558625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:17.694888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00333118c91e4186b1df62100cf52eba', 'request_id': 'req-9c01def8-e90d-4bc9-a3af-8d90fc514b73'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.702287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00333118c91e4186b1df62100cf52eba', 'request_id': 'req-9c01def8-e90d-4bc9-a3af-8d90fc514b73'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.848110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00333118c91e4186b1df62100cf52eba', 'request_id': 'req-9c01def8-e90d-4bc9-a3af-8d90fc514b73'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.863109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] The token cache is being invalidate because project 00333118c91e4186b1df62100cf52eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:17.863402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.864114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:17.865893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 926/1860] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:17 2022] DELETE /identity/v3/projects/00333118c91e4186b1df62100cf52eba => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:17.869872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:17.871303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.909240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1268-b2c0-4ea1-a7f2-9bda9175a476 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:17.982937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:17.984417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:17.995115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:17.995774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.996076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.996357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] PATH_INFO: `/v3/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.999285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=786eaa1cfbab4cc8a0ce59f0e1c6f4f5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.001285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.002361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01def8-e90d-4bc9-a3af-8d90fc514b73 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.008860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.009552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.013756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.013933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] PATH_INFO: `/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.015870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c6dbd1fd8b4028a19deeba71c73a9e)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.027098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.178336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786eaa1cfbab4cc8a0ce59f0e1c6f4f5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.178986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786eaa1cfbab4cc8a0ce59f0e1c6f4f5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.184820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c6dbd1fd8b4028a19deeba71c73a9e', 'request_id': 'req-fb82d553-266d-48be-86d1-eb3a1dd4ea50'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.193854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c6dbd1fd8b4028a19deeba71c73a9e', 'request_id': 'req-fb82d553-266d-48be-86d1-eb3a1dd4ea50'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.207402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786eaa1cfbab4cc8a0ce59f0e1c6f4f5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.311105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c6dbd1fd8b4028a19deeba71c73a9e', 'request_id': 'req-fb82d553-266d-48be-86d1-eb3a1dd4ea50'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.322483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] The token cache is being invalidate because project e9c6dbd1fd8b4028a19deeba71c73a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:18.322771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.323543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fb82d553-266d-48be-86d1-eb3a1dd4ea50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.325358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 927/1861] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:17 2022] DELETE /identity/v3/projects/e9c6dbd1fd8b4028a19deeba71c73a9e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:18.333533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.333533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.333704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.354689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:18.355240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786eaa1cfbab4cc8a0ce59f0e1c6f4f5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.355949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:18.370026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0cc43222-7af3-4890-98d6-710d223317f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786eaa1cfbab4cc8a0ce59f0e1c6f4f5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:18.370871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 935/1862] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:17 2022] DELETE /identity/v3/users/786eaa1cfbab4cc8a0ce59f0e1c6f4f5 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:18.421495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 928/1863] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:18.430305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.430826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.430826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.452022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:18.453329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:18.535894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 936/1864] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:18.539695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:18.553873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:18.562297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72d1e-b9c5-419b-ba17-43dd140b6d45 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.579435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.579435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.579435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.579435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.580282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:18.580282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.581476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.602288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:18.602621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 929/1865] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:18.605450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:18.615393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50844c-ad47-4207-a175-1b15d65464f5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.621555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.625273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.625273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.625273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.625273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.625606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.728676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 937/1866] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:18 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:18.733109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:18.745740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6949e-49c7-4a28-9246-18a9ec29db29 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.847266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.847985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.848267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.848562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.849256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.851482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:18.971826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 930/1867] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:18 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:18.973855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:18.984264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eef9b-fe4b-4bba-b0a2-5071ddcd11f2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:18.989830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:18.990223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:18.991165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:18.991165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:18.991375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:18.992980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.004507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 938/1868] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:19.008392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.021371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda1580-96e9-4be9-b176-0764dd14d3c2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.034026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.034026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.034026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.034026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.036376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.038938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.062237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 931/1869] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:19.067479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.080422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.083817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:19.087199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523066-5fd6-4b55-a4ac-d2b8a96ba766 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.099302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.105876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.105876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.105876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] PATH_INFO: `/v3/projects/6e941514ba9d431085f6384e06af50dd/users/19a1ee8b9b6b4d61b65f95494be21e57/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.122678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848722da-ad88-44b1-806f-2d8432be9e17 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.133552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.134473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.134948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.135409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] PATH_INFO: `/v3/projects/ecf9966c91294e47860514d68f91c0d6` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.137134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf9966c91294e47860514d68f91c0d6)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.139563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.148181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e941514ba9d431085f6384e06af50dd, user_id=19a1ee8b9b6b4d61b65f95494be21e57, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.150836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d21879-b85b-49b0-8c30-4e8f5f0d31c7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.219439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 939/1870] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:19 2022] PUT /identity/v3/projects/6e941514ba9d431085f6384e06af50dd/users/19a1ee8b9b6b4d61b65f95494be21e57/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:19.226661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.226938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.227219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.261591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] MFA Rules not processed for user `19a1ee8b9b6b4d61b65f95494be21e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:19.262943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:19.283701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf9966c91294e47860514d68f91c0d6', 'request_id': 'req-4ca72ade-142a-4054-8349-9b43fd313c25'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:19.316340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf9966c91294e47860514d68f91c0d6', 'request_id': 'req-4ca72ade-142a-4054-8349-9b43fd313c25'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:19.375359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 940/1871] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:19.379771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.396874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf9966c91294e47860514d68f91c0d6', 'request_id': 'req-4ca72ade-142a-4054-8349-9b43fd313c25'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:19.415543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] The token cache is being invalidate because project ecf9966c91294e47860514d68f91c0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:19.416162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:19.417267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ca72ade-142a-4054-8349-9b43fd313c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:19.419370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 932/1872] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:19 2022] DELETE /identity/v3/projects/ecf9966c91294e47860514d68f91c0d6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:19.429258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b7a3-6f26-4392-9ae1-ae75f21a932f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.430731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b7a3-6f26-4392-9ae1-ae75f21a932f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.431200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b7a3-6f26-4392-9ae1-ae75f21a932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.456209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26623-f110-4d5d-9482-ce92a7d6a7a9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.458039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0d21b7a3-6f26-4392-9ae1-ae75f21a932f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:19.461148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0d21b7a3-6f26-4392-9ae1-ae75f21a932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:19.557963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 933/1873] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:19.558277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.558852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.558852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.559319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.560311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.560524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.560998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.561317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.562513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.585577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:19.586932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:19.604852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 934/1874] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:19.613357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.623369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc9734-7ecd-4d95-b2d4-49d8620c2931 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.630710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.639091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.650925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 935/1875] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:19.651829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.665729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693e3b0-d575-4cb1-854e-727734edf78f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.674369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 941/1876] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:19.678914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.679168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.679967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.680406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.680818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.681019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:19.681748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.683922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.754870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2206e42-49c3-407e-b52b-6702726ca770 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.765085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.765870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.766253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.767821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.768077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.770361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.810207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 936/1877] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:19.814402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.890130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c9a6-d1ef-47c4-bada-176fce94f4ec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.898280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 942/1878] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:19.898548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.899242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.899329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.899472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.899708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.900459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.902579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.915084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b716b-f20d-408d-ab02-140c1f034911 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.921020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.921703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.921986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.923085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.923085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.924930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:19.935737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 943/1879] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:19.940304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:19.950098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15d121-c973-47bf-aae4-994a8e808417 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:19.955346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:19.956276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:19.956553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:19.956823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] PATH_INFO: `/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54/users/3f5366e0b1f24fa4a30774475ad9490a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:19.972637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a44c1ad7a52488b8e94998f51f9bf54, user_id=3f5366e0b1f24fa4a30774475ad9490a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:19.975647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.021118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 937/1880] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:19 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:20.025278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.036003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763657d-0234-4567-a86a-a3e99ed122a3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.042455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.044681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.044681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.044681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.044681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.046114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.048972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 944/1881] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:19 2022] PUT /identity/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54/users/3f5366e0b1f24fa4a30774475ad9490a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:20.052864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.059971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 938/1882] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:20.064769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.079995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f5f0e-6e5b-4947-a3c5-c107692f4f8f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.137245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110b9-e3c2-4bde-98fb-fd6d65355bbf admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.142495 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.142893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.143248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.143528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.144487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.146395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.147011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.147282 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.147562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.148278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.148387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.149909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.164327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 939/1883] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:20.164882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 945/1884] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:20.178977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.185412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.200806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb1b6-9678-4e37-b8b8-10719d971614 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.201063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20708-a13f-4c44-a6ac-80c78c7f8b18 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.204945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.206023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.206314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.206732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] PATH_INFO: `/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54/users/3f5366e0b1f24fa4a30774475ad9490a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.208292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.215156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.215156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.215156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] PATH_INFO: `/v3/projects/20361efafb7442e4961b4bde075b849b/users/9d6ea051d0e7419b95d8ecdf000f8f6b/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.215683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a44c1ad7a52488b8e94998f51f9bf54, user_id=3f5366e0b1f24fa4a30774475ad9490a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.215683 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b8b8-4537-444e-a48d-dd541b3153f1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.237137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 946/1885] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:20 2022] PUT /identity/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54/users/3f5366e0b1f24fa4a30774475ad9490a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:20.239243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.239535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.239810 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20361efafb7442e4961b4bde075b849b, user_id=9d6ea051d0e7419b95d8ecdf000f8f6b, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.243147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.243278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ee31-6a7a-4e35-aba9-0a71fe51f205 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.271768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] MFA Rules not processed for user `3f5366e0b1f24fa4a30774475ad9490a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:20.272090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:20.350248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 940/1886] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:20 2022] PUT /identity/v3/projects/20361efafb7442e4961b4bde075b849b/users/9d6ea051d0e7419b95d8ecdf000f8f6b/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:20.352246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.352534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.352811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.389175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 947/1887] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:20.412186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.412186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:20.412383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] MFA Rules not processed for user `9d6ea051d0e7419b95d8ecdf000f8f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:20.412383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:20.438000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:20.479337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e169f5-0a8c-467d-bf02-c731d10f27d5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.490302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 941/1888] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:20.494861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.541627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.543119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.543532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.543950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.583116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643156e-defa-4176-b271-82801e69b2d6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.587330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.588089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.588613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.588994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.590464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.592953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.629058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.629058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.639118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 948/1889] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:20.679600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 942/1890] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:20 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:20.683457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.694820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730478d-f450-4dcf-b50f-414717631f71 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.752828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.753446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.753728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.754000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.754628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.758620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.835619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 949/1891] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:20 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:20.839706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.856994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17972-d55f-4761-9d3d-25aa24c7a233 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.863347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.864115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.864494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.864893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.865640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.867381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.878668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 943/1892] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:20.882972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.899164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a77dd-c72f-4d4f-ac1e-ab41702da417 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.904742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.905487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.905841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.906210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] PATH_INFO: `/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0/users/9dab9232d5344f67a89f901145630875/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.928119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726fb7bbddc74b25a32c73fa1c73eae0, user_id=9dab9232d5344f67a89f901145630875, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.935188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.947019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:20.951709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:20.971438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4359-15d9-447b-a290-7922d064bd49 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:20.980471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:20.981226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.981565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.981948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] PATH_INFO: `/v3/users/a2d8ea9ed6094f0d955ab82be5b13848` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.983406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d8ea9ed6094f0d955ab82be5b13848)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:20.986270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:20.990777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:21.026423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 950/1893] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:20 2022] PUT /identity/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0/users/9dab9232d5344f67a89f901145630875/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:21.031697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.106040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12dd4-e370-47a0-974f-5a3b375ed860 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.111204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.111795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.112181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.112629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.113583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.115396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.126077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 951/1894] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:21.130829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.141360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7c1b1-05f7-4a4a-a610-d94359158c28 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.147183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.147891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.148333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.148620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] PATH_INFO: `/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0/users/9dab9232d5344f67a89f901145630875/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.150604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726fb7bbddc74b25a32c73fa1c73eae0, user_id=9dab9232d5344f67a89f901145630875, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.153301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453c6a8-bc01-475c-a038-d95c7cc2ea26 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.167187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 952/1895] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:21 2022] PUT /identity/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0/users/9dab9232d5344f67a89f901145630875/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:21.173628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d8ea9ed6094f0d955ab82be5b13848'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.174779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d8ea9ed6094f0d955ab82be5b13848'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.179426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dd5-336f-4d76-9625-a09f251e9352 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.179723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dd5-336f-4d76-9625-a09f251e9352 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.180032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9dd5-336f-4d76-9625-a09f251e9352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.182540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d8ea9ed6094f0d955ab82be5b13848'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.210721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-148e9dd5-336f-4d76-9625-a09f251e9352 None None] MFA Rules not processed for user `9dab9232d5344f67a89f901145630875`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:21.212005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-148e9dd5-336f-4d76-9625-a09f251e9352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.260099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d8ea9ed6094f0d955ab82be5b13848'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.288486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d8ea9ed6094f0d955ab82be5b13848'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.289030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 944/1896] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:20 2022] DELETE /identity/v3/users/a2d8ea9ed6094f0d955ab82be5b13848 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:21.290726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 953/1897] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:21.293230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.293354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.293543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.293830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.295185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.315654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:21.316923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.368577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a8cf-940e-43a5-8b84-2b51bc12374d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.373251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.373904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.374204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.374479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] PATH_INFO: `/v3/users/19a1ee8b9b6b4d61b65f95494be21e57` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.375638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a1ee8b9b6b4d61b65f95494be21e57)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.378118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.380095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 954/1898] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:21.380723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.382001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.455138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066853-efbd-465d-b135-0d7c8f6bdf07 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.459313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.459937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.460216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.460486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.529797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.533321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.542545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 955/1899] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:21.545070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.546618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.592653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a1ee8b9b6b4d61b65f95494be21e57'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.593677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a1ee8b9b6b4d61b65f95494be21e57'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.604926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a1ee8b9b6b4d61b65f95494be21e57'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.625380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97910f0d-daa9-4848-851a-ced111cca424 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.628282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.628897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.629173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.629470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.631326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.644662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.646088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff93fdb-a073-4a18-93d8-d6e1ca8f6bb8 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.656589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 956/1900] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:21.688112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a1ee8b9b6b4d61b65f95494be21e57'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.701658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a1ee8b9b6b4d61b65f95494be21e57'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:21.708203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 945/1901] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:21 2022] DELETE /identity/v3/users/19a1ee8b9b6b4d61b65f95494be21e57 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:21.712884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.713380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.714207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.752371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.754166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.761588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:21.763204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.850699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8565-eb18-437b-ae08-146a7045a4b0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.850901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 957/1902] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:21.858634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.859742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.860161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.860408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.860783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.861028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.864850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.927240 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bd4a-723e-41fd-bcda-fcf7b69e7784 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.931139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.931842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.937572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.937572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.937918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.940275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.942527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.944166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.949114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 946/1903] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:21.958176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 958/1904] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:22.380803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:22.382012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:22.398647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e077-1396-4aeb-bb9d-08066b198ad8 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:22.407583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:22.408763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:22.409190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:22.415584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] PATH_INFO: `/v3/projects/8f924e11dbb2467bacf290322722107b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:22.416494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f924e11dbb2467bacf290322722107b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:22.421498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:22.547191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:22.548973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:22.568150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f924e11dbb2467bacf290322722107b', 'request_id': 'req-71e5e7e9-45b2-4e59-bc64-8279a74650d1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.570779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342902b1-2ecc-424c-add1-4b220ff60d53 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:22.574056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:22.581610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f924e11dbb2467bacf290322722107b', 'request_id': 'req-71e5e7e9-45b2-4e59-bc64-8279a74650d1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.636722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f924e11dbb2467bacf290322722107b', 'request_id': 'req-71e5e7e9-45b2-4e59-bc64-8279a74650d1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.647387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:22.648318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:22.648500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:22.648772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] PATH_INFO: `/v3/projects/6e941514ba9d431085f6384e06af50dd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:22.650251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e941514ba9d431085f6384e06af50dd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:22.653214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:22.657745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] The token cache is being invalidate because project 8f924e11dbb2467bacf290322722107b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:22.658333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.659213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.662220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 947/1905] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:22 2022] DELETE /identity/v3/projects/8f924e11dbb2467bacf290322722107b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:22.663496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:22.665735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:22.690802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e7e9-45b2-4e59-bc64-8279a74650d1 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:22.695852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:22.696717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:22.697100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:22.697499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] PATH_INFO: `/v3/users/9d6ea051d0e7419b95d8ecdf000f8f6b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:22.703681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6ea051d0e7419b95d8ecdf000f8f6b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:22.709906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:22.765129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e941514ba9d431085f6384e06af50dd', 'request_id': 'req-f39a986f-c393-4811-8486-36b52de224c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.832602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e941514ba9d431085f6384e06af50dd', 'request_id': 'req-f39a986f-c393-4811-8486-36b52de224c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.839672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e941514ba9d431085f6384e06af50dd', 'request_id': 'req-f39a986f-c393-4811-8486-36b52de224c4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.851725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] The token cache is being invalidate because project 6e941514ba9d431085f6384e06af50dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:22.854674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.854674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.856297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 959/1906] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:22 2022] DELETE /identity/v3/projects/6e941514ba9d431085f6384e06af50dd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:22.857228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:22.859639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:22.933582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6ea051d0e7419b95d8ecdf000f8f6b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.934446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6ea051d0e7419b95d8ecdf000f8f6b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.943420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a986f-c393-4811-8486-36b52de224c4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:22.949293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6ea051d0e7419b95d8ecdf000f8f6b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:22.949941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:22.950863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:22.951339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:22.951684 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] PATH_INFO: `/v3/users/0d63609f11c646958758f78131b1c26b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:22.953496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d63609f11c646958758f78131b1c26b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:22.957259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:23.023762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6ea051d0e7419b95d8ecdf000f8f6b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.040972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6ea051d0e7419b95d8ecdf000f8f6b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.047444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 948/1907] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:22 2022] DELETE /identity/v3/users/9d6ea051d0e7419b95d8ecdf000f8f6b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:23.049019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:23.050689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:23.083600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:23.123841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b45f-b91f-4c78-848e-3d44b9f5dc7b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:23.128969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:23.129610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.132716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.132716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] PATH_INFO: `/v3/users/3f5366e0b1f24fa4a30774475ad9490a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.132716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5366e0b1f24fa4a30774475ad9490a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:23.133442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:23.137457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d63609f11c646958758f78131b1c26b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.138134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d63609f11c646958758f78131b1c26b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.152085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d63609f11c646958758f78131b1c26b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.219927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:23.248349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d63609f11c646958758f78131b1c26b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.257119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9834da53-8d92-4724-9e04-f26e4fc9e6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d63609f11c646958758f78131b1c26b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.263622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 960/1908] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:22 2022] DELETE /identity/v3/users/0d63609f11c646958758f78131b1c26b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:23.265032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.265319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.265595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.286298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:23.287475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:23.335027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5366e0b1f24fa4a30774475ad9490a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.335917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5366e0b1f24fa4a30774475ad9490a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.343726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5366e0b1f24fa4a30774475ad9490a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.373138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 961/1909] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:23.385175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:23.387460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:23.435133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5366e0b1f24fa4a30774475ad9490a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.449867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5366e0b1f24fa4a30774475ad9490a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:23.456096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1cc7-f378-484f-976b-434ba9a0b004 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:23.457266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 949/1910] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:23 2022] DELETE /identity/v3/users/3f5366e0b1f24fa4a30774475ad9490a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:23.536209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:23.537131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.537689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.538128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.644359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:23.646329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:23.660829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 962/1911] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:23.949326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:23.951887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:23.973256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dc11-50f8-4c0c-b265-5c91a8687c60 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:23.978465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:23.979634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.979634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.979837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] PATH_INFO: `/v3/projects/39234cbe1618464fb8acda502a8dbccd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.981323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39234cbe1618464fb8acda502a8dbccd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:23.983619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.137177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39234cbe1618464fb8acda502a8dbccd', 'request_id': 'req-945db7b4-d268-478b-afac-5365751b6149'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.147353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39234cbe1618464fb8acda502a8dbccd', 'request_id': 'req-945db7b4-d268-478b-afac-5365751b6149'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.202650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.202650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.216939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7f5d-07b8-48e4-9e95-cc876cd154a1 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.218472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39234cbe1618464fb8acda502a8dbccd', 'request_id': 'req-945db7b4-d268-478b-afac-5365751b6149'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.255581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] The token cache is being invalidate because project 39234cbe1618464fb8acda502a8dbccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:24.257275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.258813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-945db7b4-d268-478b-afac-5365751b6149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.264001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 950/1912] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:23 2022] DELETE /identity/v3/projects/39234cbe1618464fb8acda502a8dbccd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:24.273656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2756-0bb5-4ea7-ad3b-cda1b9266a23 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.274107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2756-0bb5-4ea7-ad3b-cda1b9266a23 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.274487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b2756-0bb5-4ea7-ad3b-cda1b9266a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.283806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.284659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.285116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.285532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] PATH_INFO: `/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.286934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a44c1ad7a52488b8e94998f51f9bf54)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.289144 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.328826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-420b2756-0bb5-4ea7-ad3b-cda1b9266a23 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:24.333394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-420b2756-0bb5-4ea7-ad3b-cda1b9266a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.343902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 951/1913] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:24.352081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.352715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.355620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.379963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:24.382327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.397710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 952/1914] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:24.402515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.419325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa39425-712e-4e07-b017-4daf5a846f66 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.420880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:24.432706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a44c1ad7a52488b8e94998f51f9bf54', 'request_id': 'req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.501128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.503430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.503569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a44c1ad7a52488b8e94998f51f9bf54', 'request_id': 'req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.504023 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.504490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.505369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:24.505878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.507991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.516645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a44c1ad7a52488b8e94998f51f9bf54', 'request_id': 'req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.529318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 953/1915] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:41:24.536269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.536857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:24.540649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] The token cache is being invalidate because project 2a44c1ad7a52488b8e94998f51f9bf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:24.541010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.541821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b9e9e4dd-54c6-4ea0-8a4d-a2557eaad0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:24.547458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 963/1916] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:24 2022] DELETE /identity/v3/projects/2a44c1ad7a52488b8e94998f51f9bf54 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:24.549540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b1ad-2f76-4a3d-90a4-b41a697be03b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.550399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b1ad-2f76-4a3d-90a4-b41a697be03b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.550399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b1ad-2f76-4a3d-90a4-b41a697be03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.567928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39e9b-f56c-4e43-9a3f-5d72169bfa0b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.574231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.575246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.575678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.576126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.577421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.580338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.588362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-18f0b1ad-2f76-4a3d-90a4-b41a697be03b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:24.593076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-18f0b1ad-2f76-4a3d-90a4-b41a697be03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.604193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 964/1917] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:24.613431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.617063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.617063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.643209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:24.644899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.664610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 965/1918] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:24.669441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.695518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914b65-831c-4ed4-bd18-dc62be250964 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.700892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.701625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.703299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.703660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.705433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:24.708821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.708821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.723919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 966/1919] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:24.728607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.739957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 954/1920] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:24.741419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.743775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.750940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886c24-59c4-4abe-a028-692bdd8c1a2b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.841403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75bfe-529e-49da-9660-e030d058c920 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.852420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.853814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.854198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.854568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.856137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.857726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.906275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.907158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.907669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.908271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.909210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.913409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.994890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 955/1921] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:24.996351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.998484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.045669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d0d09-8548-46c1-a640-e2e577dc0a13 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.045669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.045669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.045669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.046303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] PATH_INFO: `/v3/projects/20361efafb7442e4961b4bde075b849b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.046303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20361efafb7442e4961b4bde075b849b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.046303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.164880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 967/1922] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:25.165904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.268604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20361efafb7442e4961b4bde075b849b', 'request_id': 'req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.281222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83bf8-02a5-4767-af33-a3e9a5e7f553 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.283799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20361efafb7442e4961b4bde075b849b', 'request_id': 'req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.374266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20361efafb7442e4961b4bde075b849b', 'request_id': 'req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.389862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] The token cache is being invalidate because project 20361efafb7442e4961b4bde075b849b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:25.390193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.390961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.393102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 956/1923] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:24 2022] DELETE /identity/v3/projects/20361efafb7442e4961b4bde075b849b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:25.394533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.395990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.401147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.401833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.402118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.402395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.403062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.405326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.422072 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 968/1924] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:25.424739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ece5-aa53-46dc-97e7-72fe659f18d0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.427564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.429776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.448522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.450502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.452007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.453479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.454407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0032c4-5cf8-4c6a-9bd9-b88bf7d434da admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.456507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.460918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.461086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.462134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.462532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.462900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] PATH_INFO: `/v3/users/9dab9232d5344f67a89f901145630875` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.464221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dab9232d5344f67a89f901145630875)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.468288 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.596705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 957/1925] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:25 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:25.597589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.601396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.614672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbde3e-ae27-4af6-85f4-46956a3a5ae9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.620276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.621261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.621261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.621482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.622256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.623954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.637726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 958/1926] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:25.637726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.650043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885641-8831-4bb2-a253-f785be7f33d9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.654702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.655308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.655583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.655877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.656510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.663415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.675851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 959/1927] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:25.675851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.684705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e701a-9769-4fd5-98ac-420b4f0beb3c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:25.689623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:25.695411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.695411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.695411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] PATH_INFO: `/v3/projects/14d3cc3a962a40dbb3927614f11171e0/users/df6acc2b7cfc41169120c87a337af5cd/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.707673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3cc3a962a40dbb3927614f11171e0, user_id=df6acc2b7cfc41169120c87a337af5cd, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:25.710413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:25.741966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dab9232d5344f67a89f901145630875'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.743408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dab9232d5344f67a89f901145630875'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.764500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dab9232d5344f67a89f901145630875'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.785053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 960/1928] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:25 2022] PUT /identity/v3/projects/14d3cc3a962a40dbb3927614f11171e0/users/df6acc2b7cfc41169120c87a337af5cd/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:25.785891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:25.799144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.841115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dab9232d5344f67a89f901145630875'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.850888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a88dfba0-64ba-40b7-bb75-b85cbdc8676b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dab9232d5344f67a89f901145630875'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:25.862281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 969/1929] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:25 2022] DELETE /identity/v3/users/9dab9232d5344f67a89f901145630875 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:25.863773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:25.866613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:25.867126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:25.929904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] MFA Rules not processed for user `df6acc2b7cfc41169120c87a337af5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:25.932745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:25.937297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:25.969516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0855-71f3-44f1-84e2-ece215b62097 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.054645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:26.062944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.063621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.064873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.065366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.066161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.067775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.090917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 961/1930] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:26.092643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.094462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 970/1931] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:26.099724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.101988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:26.112072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f455da-7f61-4c62-bd63-8c3312a1eb46 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.119175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.119850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.120181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.120453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] PATH_INFO: `/v3/projects/c280864957b44f9389a9cd4e5c45a7be/users/7a58bd76a9d645e88a7ef8a10a8f6b85/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.134528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d358ed-119e-4426-9fcf-393cc2cca70d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.138497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c280864957b44f9389a9cd4e5c45a7be, user_id=7a58bd76a9d645e88a7ef8a10a8f6b85, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.141468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a17335-1dea-4883-ae63-c0f04a22d891 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.149511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.150228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.150494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.150770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.151434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.153543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.215983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 962/1932] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:26 2022] PUT /identity/v3/projects/c280864957b44f9389a9cd4e5c45a7be/users/7a58bd76a9d645e88a7ef8a10a8f6b85/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:26.227737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.228170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.228484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.272203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] MFA Rules not processed for user `7a58bd76a9d645e88a7ef8a10a8f6b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:26.273540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:26.274068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 971/1933] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:26 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:26.288596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.419060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211502-756b-4568-8283-be7d22fc4ee3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.426102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.426930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.427310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.427692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.428444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.431677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.487825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 963/1934] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:26.498842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.508580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:26.566540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 972/1935] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:26 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:26.570346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.586342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65888558-fd7d-471e-b634-d12e8b6e20de admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.588442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3cbb6-8a72-4672-bf83-5a91ea57a470 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.593518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.594153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.594841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.595550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.595905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.596215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.596635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.597697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.598622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.600524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.614003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 973/1936] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:26.618603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.618603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:26.622956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.624929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.631159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fa89-e646-47a7-a867-b17656b2d484 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.636383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.636991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.637277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.637553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] PATH_INFO: `/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.640869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726fb7bbddc74b25a32c73fa1c73eae0)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.642472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 964/1937] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:26.644060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.653363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.658709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d988cf-8a2d-40dc-a3c9-7c300e1d44a3 service glance] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.670510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:26.671489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.671910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.672425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] PATH_INFO: `/v3/projects/877e5c79f6f34653ae25c902f858357c/users/301bc1aebe6d49abac2ba810b029266c/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:26.694433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877e5c79f6f34653ae25c902f858357c, user_id=301bc1aebe6d49abac2ba810b029266c, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:26.697412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:26.804420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 965/1938] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:26 2022] PUT /identity/v3/projects/877e5c79f6f34653ae25c902f858357c/users/301bc1aebe6d49abac2ba810b029266c/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:26.808280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:26.811413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726fb7bbddc74b25a32c73fa1c73eae0', 'request_id': 'req-74828e9c-f5ff-4038-9014-607f6767ffa0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:26.884505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726fb7bbddc74b25a32c73fa1c73eae0', 'request_id': 'req-74828e9c-f5ff-4038-9014-607f6767ffa0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:26.943844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726fb7bbddc74b25a32c73fa1c73eae0', 'request_id': 'req-74828e9c-f5ff-4038-9014-607f6767ffa0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:26.981982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] The token cache is being invalidate because project 726fb7bbddc74b25a32c73fa1c73eae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:26.982350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:26.985293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74828e9c-f5ff-4038-9014-607f6767ffa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:26.989084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 974/1939] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:26 2022] DELETE /identity/v3/projects/726fb7bbddc74b25a32c73fa1c73eae0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:26.989283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b5d8-30bf-4158-838c-e663f4de56e9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:26.993933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:26.994224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:26.995157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.026003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:27.028186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:27.156487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.159078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.159078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.159078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.159447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.161570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37815153-3eb9-4d0a-b960-0b8692508603 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.183898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 975/1940] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:27.187694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:27.187694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 966/1941] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:27.187995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:27.194474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.194754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.195031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.196714 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:27.216385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:27.223816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5de88a-c78c-4330-b85f-a7a4943f89dd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:27.229363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:27.230811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:27.242702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.245034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.245034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.245034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] PATH_INFO: `/v3/projects/877e5c79f6f34653ae25c902f858357c/users/301bc1aebe6d49abac2ba810b029266c/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.249088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=877e5c79f6f34653ae25c902f858357c, user_id=301bc1aebe6d49abac2ba810b029266c, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.252156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbc17-961d-43bf-81f9-b0ba4db1bf7b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.261310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 967/1942] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:27.266601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:27.299838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797316dd-faf8-474c-b6af-a3606c4a0319 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:27.305091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 976/1943] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:27 2022] PUT /identity/v3/projects/877e5c79f6f34653ae25c902f858357c/users/301bc1aebe6d49abac2ba810b029266c/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:27.318005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.318289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.318561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.395210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] MFA Rules not processed for user `301bc1aebe6d49abac2ba810b029266c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:27.396744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:27.428842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.431008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.431008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.431008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.431906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:27.432423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.435289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.488294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 968/1944] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:27.496593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:27.514492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec6ac-9217-4f92-a204-795143f1793d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:27.522839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.524202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.524202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.524751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.525830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.528005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.585654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 977/1945] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:27.671945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:27.673977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 969/1946] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:27 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:27.674491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:27.678041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:27.794527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee05951-3ba2-4d54-b8b5-bbf03fc9c7ed None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:27.843175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35997f-7221-4c5c-b6b1-bf8e6ea4f6de admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:27.849221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.851079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.851079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.851079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.851420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.853707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.861982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:27.863331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:27.863964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:27.864438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:27.869815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:27.952768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:27.955374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:27.972908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 978/1947] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:27.977296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 970/1948] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:27 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:27.981471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:28.009959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd49c2-bc2a-4f07-9b68-a7ecf95225e2 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:28.016622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:28.018100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.018386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.018644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.019285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:28.022889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:28.053625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 979/1949] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:28.055062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:28.082540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a023d10-3b3d-4b29-91b4-b0a87be52827 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:28.088758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:28.089389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.089677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.089952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.090604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:28.092315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295f093-c819-4141-9ff0-66a57b0eea11 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:28.115911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 971/1950] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:28.123160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:28.147883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f03a4-3b62-4040-a13e-de002403bbe3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:28.164620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:28.164620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.164620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.164620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] PATH_INFO: `/v3/projects/305b82ae25854b88bbfa5ed75c8471d7/users/a6efcabbd23c4ed6af176b0365cafaf1/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.193653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305b82ae25854b88bbfa5ed75c8471d7, user_id=a6efcabbd23c4ed6af176b0365cafaf1, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:28.193653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:28.312799 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 980/1951] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:28 2022] PUT /identity/v3/projects/305b82ae25854b88bbfa5ed75c8471d7/users/a6efcabbd23c4ed6af176b0365cafaf1/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:28.318286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.318569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.318850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.354858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] MFA Rules not processed for user `a6efcabbd23c4ed6af176b0365cafaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:28.356126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:28.430444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 972/1952] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:28.444160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:28.446105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:28.505781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ed17-5b16-42e8-b50a-321eac035ee5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:28.509665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:28.510299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.510580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.510921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.519966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:28.521411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619f0e-12dc-4981-bfc4-f1335d272942 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:28.530671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 981/1953] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:28.553870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:28.620785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26bf3e-63ec-49dd-94e1-fb4fcfce4775 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:28.622467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:28.623133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.623408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.623675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] PATH_INFO: `/v3/users/a6efcabbd23c4ed6af176b0365cafaf1` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.624861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6efcabbd23c4ed6af176b0365cafaf1)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:28.626770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:28.797497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6efcabbd23c4ed6af176b0365cafaf1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:28.797497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6efcabbd23c4ed6af176b0365cafaf1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:28.806438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6efcabbd23c4ed6af176b0365cafaf1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:28.880323 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6efcabbd23c4ed6af176b0365cafaf1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:28.895555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6efcabbd23c4ed6af176b0365cafaf1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:28.902156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 973/1954] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:28 2022] DELETE /identity/v3/users/a6efcabbd23c4ed6af176b0365cafaf1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:28.906925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:28.908750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:28.909037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:28.931359 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:28.932638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:28.996389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 982/1955] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:29.006062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:29.007460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:29.052245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:29.053839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:29.065726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b442c-e757-43ab-a7dc-c657aa4d7314 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:29.068314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0a6a-5333-4dcb-abe5-7b472bb23cf5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:29.070450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:29.071081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.071375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.071634 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] PATH_INFO: `/v3/users/df6acc2b7cfc41169120c87a337af5cd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:29.072061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:29.072752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.072962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6acc2b7cfc41169120c87a337af5cd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:29.073055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.073289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:29.074897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:29.088215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:29.089757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9ca4c-fd5b-4863-b951-6e0936c51c54 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:29.101806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 974/1956] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:29.343249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6acc2b7cfc41169120c87a337af5cd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.344417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6acc2b7cfc41169120c87a337af5cd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.358098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6acc2b7cfc41169120c87a337af5cd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.436797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6acc2b7cfc41169120c87a337af5cd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.443639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:29.448555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6acc2b7cfc41169120c87a337af5cd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.458788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 983/1957] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:29 2022] DELETE /identity/v3/users/df6acc2b7cfc41169120c87a337af5cd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:29.463212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.463568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.463935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:29.494186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:29.495426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:29.507897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:29.571231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 975/1958] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:29.581471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:29.582942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:29.645806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:29.647224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:29.650148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4829-22b7-4f22-9b1e-0162d5dd5fe3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:29.654136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:29.654806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.655152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.656040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:29.666383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b3007-0dcc-41ea-b65d-cbb0eaf13d58 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:29.669284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:29.671027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ee023-4359-436f-948c-c491c1db0dcd service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:29.672584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:29.673330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.673633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.673908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] PATH_INFO: `/v3/projects/305b82ae25854b88bbfa5ed75c8471d7` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:29.677090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=305b82ae25854b88bbfa5ed75c8471d7)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:29.679447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:29.682785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 984/1959] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:29.833173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305b82ae25854b88bbfa5ed75c8471d7', 'request_id': 'req-a80190d7-d13f-4bf3-ab02-79f3b6796a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.839376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305b82ae25854b88bbfa5ed75c8471d7', 'request_id': 'req-a80190d7-d13f-4bf3-ab02-79f3b6796a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.950997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305b82ae25854b88bbfa5ed75c8471d7', 'request_id': 'req-a80190d7-d13f-4bf3-ab02-79f3b6796a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.964298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] The token cache is being invalidate because project 305b82ae25854b88bbfa5ed75c8471d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:29.964759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.966255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a80190d7-d13f-4bf3-ab02-79f3b6796a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:29.968262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 976/1960] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:29 2022] DELETE /identity/v3/projects/305b82ae25854b88bbfa5ed75c8471d7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:29.975696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:29.976478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:29.976478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.001053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:30.003215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.078875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 985/1961] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:30.088092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.088399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.088811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.110296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:30.112402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.120802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 977/1962] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:30.125225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.147611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ee2a-891b-41e8-bfcd-d0c338014b1e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.161777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.162643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.163722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.170965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.170965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:30.170965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.170965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.175026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.177588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.183337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 986/1963] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:30.188095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.200691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00416c-7320-40e0-91bb-3390755e7774 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.200948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97adc-67b7-495c-bccc-030c2da08850 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.201694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.202345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.202561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.202887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] PATH_INFO: `/v3/projects/14d3cc3a962a40dbb3927614f11171e0` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.204452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d3cc3a962a40dbb3927614f11171e0)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.206099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.206823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.207277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.207554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.207738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.208222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.210116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.325838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 987/1964] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:30 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:30.328231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.366995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d3cc3a962a40dbb3927614f11171e0', 'request_id': 'req-b995aa95-5716-4309-afe7-78754b075b86'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.373244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d3cc3a962a40dbb3927614f11171e0', 'request_id': 'req-b995aa95-5716-4309-afe7-78754b075b86'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.395809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdee91-13cb-4116-8f00-6a35b25518cd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.453023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.453591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.453875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.454147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.456169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.458232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.466141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d3cc3a962a40dbb3927614f11171e0', 'request_id': 'req-b995aa95-5716-4309-afe7-78754b075b86'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.478433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] The token cache is being invalidate because project 14d3cc3a962a40dbb3927614f11171e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:30.478727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.479394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.480989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 978/1965] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:30 2022] DELETE /identity/v3/projects/14d3cc3a962a40dbb3927614f11171e0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:30.484794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.486072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.498160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995aa95-5716-4309-afe7-78754b075b86 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.502951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.503563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.503838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.504129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] PATH_INFO: `/v3/users/301bc1aebe6d49abac2ba810b029266c` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.505221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=301bc1aebe6d49abac2ba810b029266c)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.507107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.582473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 988/1966] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:30 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:30.584695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.586302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.598679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c5de-a35b-4a21-b637-71b1ad763705 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.603489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.604118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.618594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.618594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.618594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.618594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.618594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 989/1967] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:30.621097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.631337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082914b-0dd9-450d-9998-9f7a4181ff78 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.636182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.636778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.637063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.637338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.637972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.639583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.651995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 990/1968] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:30.658724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.668552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341bf4-9a0d-4f62-956f-95bf12261214 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:30.673503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:30.674485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.674763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.675222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] PATH_INFO: `/v3/projects/35b48c18ba144e92bea950201bf46001/users/3919d2ac09564166beff4d7b1306dbb2/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.690456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b48c18ba144e92bea950201bf46001, user_id=3919d2ac09564166beff4d7b1306dbb2, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:30.693260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaedc1-6db3-4f46-a712-2781cd0918d3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:30.805665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 991/1969] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:30 2022] PUT /identity/v3/projects/35b48c18ba144e92bea950201bf46001/users/3919d2ac09564166beff4d7b1306dbb2/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:30.810136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301bc1aebe6d49abac2ba810b029266c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.810933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301bc1aebe6d49abac2ba810b029266c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.816150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:30.816433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:30.816737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:30.820294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301bc1aebe6d49abac2ba810b029266c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.846269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] MFA Rules not processed for user `3919d2ac09564166beff4d7b1306dbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:30.847528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.916825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301bc1aebe6d49abac2ba810b029266c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.921554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 992/1970] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:30.934676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301bc1aebe6d49abac2ba810b029266c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:30.936030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:30.937551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:30.944064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 979/1971] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:30 2022] DELETE /identity/v3/users/301bc1aebe6d49abac2ba810b029266c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:31.016431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6ef5-ea0e-44c7-ab87-8fdf5458712f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:31.081737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:31.081954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:31.082176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:31.082463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:31.151409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:31.152878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d88e-d1eb-40ba-8e49-84d5cb8b4ec5 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:31.163958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 993/1972] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:31.363740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:31.420300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:31.831195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:31.831195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:31.922568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a59b-42a5-4c34-96d9-bdccfc875917 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:31.927512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:31.928174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:31.928465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:31.928750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] PATH_INFO: `/v3/projects/877e5c79f6f34653ae25c902f858357c` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:31.929882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=877e5c79f6f34653ae25c902f858357c)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:31.931812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.041532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877e5c79f6f34653ae25c902f858357c', 'request_id': 'req-d8215685-c067-4b3a-aacb-75229b257cfa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:32.046513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:32.050608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877e5c79f6f34653ae25c902f858357c', 'request_id': 'req-d8215685-c067-4b3a-aacb-75229b257cfa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:32.135093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877e5c79f6f34653ae25c902f858357c', 'request_id': 'req-d8215685-c067-4b3a-aacb-75229b257cfa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:32.148866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] The token cache is being invalidate because project 877e5c79f6f34653ae25c902f858357c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:32.149166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:32.150317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d8215685-c067-4b3a-aacb-75229b257cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:32.152053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 980/1973] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:31 2022] DELETE /identity/v3/projects/877e5c79f6f34653ae25c902f858357c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:32.156793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.157318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.158036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.195390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:32.196699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:32.275012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 994/1974] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:32.283501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.284109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.284268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.311324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:32.312719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:32.321154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 981/1975] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:32.325423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.339693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ccca3-ced5-40b4-af44-525bd1e5b407 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.344785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.346193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.346560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.346831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.347480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:32.347790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.349513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.362912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 995/1976] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:32.367296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.377239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810657bc-94cc-4c8f-8392-a060db2c20cb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.382306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.382977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.383254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.384532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.384532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.386186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.508482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 982/1977] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:32 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:32.512702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.523063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003f2c-7249-4c0c-b89e-4dc0726f477e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.588556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.589173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.589458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.589728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.590563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.592522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.703826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 996/1978] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:32 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:32.706275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.717307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71a443-af2c-4bfb-b579-eb6f8bff8686 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.722678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.723261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.723540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.723833 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.724474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.726071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.736329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 983/1979] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:32.740437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.750216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784b31-7e99-4d40-a675-e8adcec99d35 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.754851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.757951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.757951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.757951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.757951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.758280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990477e2-d352-449e-b461-c19019771d6a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.770152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 997/1980] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:32.774444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:32.785604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8300-e32d-4799-b601-5a53e1da51c7 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:32.790773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:32.791427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.791707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.792008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] PATH_INFO: `/v3/projects/ad24092f5b194b92a3665f8cf240342b/users/e66055e6392c4e45a377a9bd2bd5d457/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.807295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad24092f5b194b92a3665f8cf240342b, user_id=e66055e6392c4e45a377a9bd2bd5d457, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:32.809948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:32.910929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 984/1981] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:32 2022] PUT /identity/v3/projects/ad24092f5b194b92a3665f8cf240342b/users/e66055e6392c4e45a377a9bd2bd5d457/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:32.924708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:32.925139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:32.925561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:32.960053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] MFA Rules not processed for user `e66055e6392c4e45a377a9bd2bd5d457`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:32.961262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:33.027131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 998/1982] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:33.031673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.092002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:33.096061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e842c4-d536-4615-9e02-29abae6f5945 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.100636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.101232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.101546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.101819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.102444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.104382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.187578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 985/1983] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:33 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:33.189431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.200985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df46e-7e1c-429e-a713-382091a6b874 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.276451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.278293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.278293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.278293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.278293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.280602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.400498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 999/1984] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:33 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:33.404662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.416456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf553e6-bd45-4d29-bdbd-edca7b374e5b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.423585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.424445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.427397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.427397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.427397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.427757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.447875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 986/1985] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:33.448734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.462410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee63fbf-80c2-4412-a1d6-c656aea57e82 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.467273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.468016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.468294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.468565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] PATH_INFO: `/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977/users/4241ddcab17b4b31930ebdfc20e960a6/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.483361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a6b4828ba9481eaa8fdd800e64f977, user_id=4241ddcab17b4b31930ebdfc20e960a6, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.486909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.537370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:33.628147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1000/1986] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:33 2022] PUT /identity/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977/users/4241ddcab17b4b31930ebdfc20e960a6/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:33.631253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.649386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ed1e-aa55-468e-82b8-08a1def767ec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.715349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.715977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.716250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.716513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.717193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.718766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84988-622e-4ae1-8ad8-40d958d55d04 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.733136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 987/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:33.734474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.746243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a79b-d744-4838-95a1-0048e27c236b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.751899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.752394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.752858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.753132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] PATH_INFO: `/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977/users/4241ddcab17b4b31930ebdfc20e960a6/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.755039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a6b4828ba9481eaa8fdd800e64f977, user_id=4241ddcab17b4b31930ebdfc20e960a6, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.757940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:33.770581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1001/1988] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:33 2022] PUT /identity/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977/users/4241ddcab17b4b31930ebdfc20e960a6/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:33.785170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.785466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.785730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.821402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] MFA Rules not processed for user `4241ddcab17b4b31930ebdfc20e960a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:33.822774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:33.895399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 988/1989] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:33.907009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:33.911104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:33.970670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b659-862b-4450-ba1a-ee3c08d1fe9b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:33.975331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:33.976031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:33.976309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:33.976596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:33.987564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:33.989073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673d63-dc52-4163-9436-8521a7e8d3f4 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:34.003926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1002/1990] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:34.195000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:34.206169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6184c-bdb8-4144-b4b9-0cef9f165da6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:34.210017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:34.210636 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:34.210911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:34.211376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:34.270978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:34.275995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3111580-8db8-4e23-90e3-ee7573a415b9 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:34.281479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 989/1991] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:34.928584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:35.497570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:36.756726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:37.463131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:38.743862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:39.356621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:40.143903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:40.372888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:40.372888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:40.372888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:40.374421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1003/1992] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:40.387199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:40.388035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:40.388539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:40.413157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:40.414370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:40.497828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 990/1993] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:40.513516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:40.514727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:40.533037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203560f-a42c-443d-9cf8-229a156958ce None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:40.538368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:40.539036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:40.539319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:40.539665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:40.549349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:40.550913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:40.561350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1004/1994] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:40.587986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:40.593840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:40.600149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:40.665344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960243-91c1-4a64-b010-6e93b512be28 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:40.669926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:40.670552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:40.671441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:40.671715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] PATH_INFO: `/v3/users/806a6eb77a06442481ecc1a4004ee57b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:40.673497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] RBAC: Authorizing `identity:delete_user(user_id=806a6eb77a06442481ecc1a4004ee57b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:40.675547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:40.914479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806a6eb77a06442481ecc1a4004ee57b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:40.915141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806a6eb77a06442481ecc1a4004ee57b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:40.922037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806a6eb77a06442481ecc1a4004ee57b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.025317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806a6eb77a06442481ecc1a4004ee57b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.040429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6bb9127-fbcd-4dd6-9d82-e14f02ee112a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806a6eb77a06442481ecc1a4004ee57b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.056921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 991/1995] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:40 2022] DELETE /identity/v3/users/806a6eb77a06442481ecc1a4004ee57b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:41.220758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:41.346992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:41.358686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981a47-e9bc-448a-9ffd-36babd384450 service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:41.417929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:41.418671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:41.418946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:41.419210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] PATH_INFO: `/v3/projects/adfbd67c9df44e10ae7b19d9c75d5947` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:41.420349 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfbd67c9df44e10ae7b19d9c75d5947)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:41.422242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:41.569448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfbd67c9df44e10ae7b19d9c75d5947', 'request_id': 'req-19ab1997-5ad0-48dd-bf6d-096acac755e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.685516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfbd67c9df44e10ae7b19d9c75d5947', 'request_id': 'req-19ab1997-5ad0-48dd-bf6d-096acac755e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.693198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfbd67c9df44e10ae7b19d9c75d5947', 'request_id': 'req-19ab1997-5ad0-48dd-bf6d-096acac755e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.706912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] The token cache is being invalidate because project adfbd67c9df44e10ae7b19d9c75d5947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:41.707215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.708149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19ab1997-5ad0-48dd-bf6d-096acac755e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:41.709734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1005/1996] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:41 2022] DELETE /identity/v3/projects/adfbd67c9df44e10ae7b19d9c75d5947 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:41.714609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:41.715166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:41.715166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:41.734367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:41.736109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:41.796075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 992/1997] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:41.805454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:41.805675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:41.805950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:41.826216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:41.827437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:41.835740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1006/1998] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:41.840060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:41.850207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919fa5-8fd6-4f79-ae21-23a6e24c90d6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:41.854900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:41.855514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:41.855813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:41.856080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:41.856728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:41.857026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:41.858764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:41.865668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:41.871553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 993/1999] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:41:41.878561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:41.887527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e1b9a-a2b7-45f0-b134-336d54638792 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:41.892405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:41.893006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:41.893285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:41.893552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:41.894199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:41.896116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:41.984070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1007/2000] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:41 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:41.988734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:41.998906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664d44-6697-49a5-88ad-0dc48478d23d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.060733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.061457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.061844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.062209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.062909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.064972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.177617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 994/2001] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:41 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:42.178856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.189886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf559b03-b177-4ee9-8bc6-9aa0ed38674d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.194631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.195237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.195518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.195839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.196483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.198074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.211342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1008/2002] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:42.213046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.227376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374dc6-0218-4f46-bf34-a8e09235bbab admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.230191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.230800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.231080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.231352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.232101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.234160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035796d-3940-4d99-b6d1-070818b16972 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.246696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 995/2003] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:42.251090 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.261551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd27e-a1dc-45a9-9b67-24ad9e56ed35 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.266297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.267368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.267658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.267960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] PATH_INFO: `/v3/projects/f039dcb432f748b58cd62fd7c052fe5e/users/6229e66d21a4435b953bf789360e29ff/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.283826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f039dcb432f748b58cd62fd7c052fe5e, user_id=6229e66d21a4435b953bf789360e29ff, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.286599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.373929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:42.380016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1009/2004] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:42 2022] PUT /identity/v3/projects/f039dcb432f748b58cd62fd7c052fe5e/users/6229e66d21a4435b953bf789360e29ff/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:42.389987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.390275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.390552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.422321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] MFA Rules not processed for user `6229e66d21a4435b953bf789360e29ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:42.423567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:42.493542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 996/2005] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:42.498286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.568645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a74ee-65f0-47ce-bcb2-a7f23e68da13 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.573588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.574193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.574470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.574739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.575357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.577265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.682602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1010/2006] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:42 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:42.687361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.698496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb03d-68e9-4429-bdb4-5560703efe87 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.758559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.759322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.759608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.760046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.760925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.763402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.802252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:42.877404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 997/2007] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:42 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:42.881677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.892576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19b8bc-0e83-4d9b-9662-cd5d4582f1b4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.897278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.897869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.898166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.898418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.899046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.900789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:42.911549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1011/2008] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:42.915873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:42.925969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde92fe-ee3e-4c88-ab19-4677d3140527 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:42.930420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:42.931059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:42.931383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:42.931703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] PATH_INFO: `/v3/projects/19011edb29be4b19ac8dbda39d48c368/users/7858ee235c224ff3bd193460d62207b4/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:42.946653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19011edb29be4b19ac8dbda39d48c368, user_id=7858ee235c224ff3bd193460d62207b4, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:42.949314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:43.052422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 998/2009] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:42 2022] PUT /identity/v3/projects/19011edb29be4b19ac8dbda39d48c368/users/7858ee235c224ff3bd193460d62207b4/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:43.056517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:43.067301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67633b4-f25c-4b24-b96c-605f4679f6b8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:43.129514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:43.130130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:43.130409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:43.130688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:43.131337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:43.132960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc60486-e4ef-44fe-9087-3a812415ccac admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:43.146400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1012/2010] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:43.153129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:43.162880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3d99-4fa5-434c-a0a6-cdc4ff8a0dc0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:43.168145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:43.168813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:43.169093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:43.169364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] PATH_INFO: `/v3/projects/19011edb29be4b19ac8dbda39d48c368/users/7858ee235c224ff3bd193460d62207b4/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:43.171305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19011edb29be4b19ac8dbda39d48c368, user_id=7858ee235c224ff3bd193460d62207b4, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:43.174777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:43.185651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 999/2011] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:43 2022] PUT /identity/v3/projects/19011edb29be4b19ac8dbda39d48c368/users/7858ee235c224ff3bd193460d62207b4/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:43.196970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:43.197333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:43.197609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:43.226200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] MFA Rules not processed for user `7858ee235c224ff3bd193460d62207b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:43.227485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:43.297575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:43.308129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1013/2012] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:43.321649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:43.323327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:43.382686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83488b66-f914-4d1f-bcc0-9314c0dc45c0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:43.386868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:43.387477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:43.387755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:43.388071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:43.397685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:43.399251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:43.409068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1000/2013] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:43.574558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:43.627711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:43.629174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:43.646283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34bb4-b1dc-4c60-b607-2836381f1a04 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:43.646283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:43.646283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:43.646748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:43.646748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:43.709730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:43.711215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506c997-ad63-4f25-b9d7-6b3b4faa6f26 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:43.721093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1014/2014] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:43.994577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:44.293544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:44.296426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:44.389517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eaf7c-5512-45c8-90ae-acfabeca78b4 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:44.394838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:44.395467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:44.395747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:44.396053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] PATH_INFO: `/v3/users/f97dbba7a19240c582f8e24f48cb0c9f` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:44.397190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97dbba7a19240c582f8e24f48cb0c9f)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:44.399097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:44.661712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97dbba7a19240c582f8e24f48cb0c9f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:44.662428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97dbba7a19240c582f8e24f48cb0c9f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:44.669334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97dbba7a19240c582f8e24f48cb0c9f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:44.794789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97dbba7a19240c582f8e24f48cb0c9f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:44.797206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:44.810906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97dbba7a19240c582f8e24f48cb0c9f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:44.819302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1001/2015] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:44 2022] DELETE /identity/v3/users/f97dbba7a19240c582f8e24f48cb0c9f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:44.823970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:44.824404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:44.824563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:44.845896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:44.847188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:44.920443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1015/2016] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:44.932101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:44.974314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:44.994996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403c30-feed-4164-88d5-a8f96e7127aa admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:44.998583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:44.999191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:44.999468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:44.999769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.009844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:45.011334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0616c-713a-4e0c-951e-f2d89fa977b3 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:45.022234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1002/2017] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:45.071999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:45.073438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.088758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac8cfa-04ff-475b-9a78-46bd68218a2f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:45.093881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:45.094624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.095013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.095380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] PATH_INFO: `/v3/users/e66055e6392c4e45a377a9bd2bd5d457` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.097206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66055e6392c4e45a377a9bd2bd5d457)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:45.099222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:45.333513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66055e6392c4e45a377a9bd2bd5d457'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.334257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66055e6392c4e45a377a9bd2bd5d457'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.348817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66055e6392c4e45a377a9bd2bd5d457'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.429187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66055e6392c4e45a377a9bd2bd5d457'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.439430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66055e6392c4e45a377a9bd2bd5d457'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.444299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1016/2018] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:45 2022] DELETE /identity/v3/users/e66055e6392c4e45a377a9bd2bd5d457 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:45.448783 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.449263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.449350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.467510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:45.469023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.474211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:45.484148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.572489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1003/2019] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:45.576605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a016fa-a1bd-4bce-9a09-c97997371aec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:45.587168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:45.587335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:45.587440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.587440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.587440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] PATH_INFO: `/v3/projects/124f0b3af2684a7cad46b92f35869d38` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.587690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.587775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124f0b3af2684a7cad46b92f35869d38)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:45.587775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:45.611562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:45.642104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dbd67-1189-45e6-ae5c-8e119aabe427 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:45.646964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:45.647852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.648182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.648488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.659047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:45.660916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493ac87-ed97-4321-97f6-fc23f87937ea service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:45.670860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1004/2020] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:45.723969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124f0b3af2684a7cad46b92f35869d38', 'request_id': 'req-15e0e523-2a84-4d05-bd5f-09abad328bd0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.778957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124f0b3af2684a7cad46b92f35869d38', 'request_id': 'req-15e0e523-2a84-4d05-bd5f-09abad328bd0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.785877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124f0b3af2684a7cad46b92f35869d38', 'request_id': 'req-15e0e523-2a84-4d05-bd5f-09abad328bd0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.796833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] The token cache is being invalidate because project 124f0b3af2684a7cad46b92f35869d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:45.797234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.797910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e0e523-2a84-4d05-bd5f-09abad328bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:45.799694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1017/2021] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:45 2022] DELETE /identity/v3/projects/124f0b3af2684a7cad46b92f35869d38 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:45.804315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.804707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.805059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.830667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:45.832064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.899727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1005/2022] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:45.916251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.916251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.916251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.929571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:45.942022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:45.943317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1018/2023] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:45.947355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:45.957704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a61e20-b7c2-4b08-8ae6-737e618e9dd9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:45.962299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:45.962898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.963171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.963436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.964109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:45.964404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:45.965990 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:45.977693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1006/2024] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:45.982108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:45.991335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3214da-b9ab-4e49-ac50-551a13d89e85 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:45.996607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:45.997213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:45.997480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:45.997746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:45.998377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.000290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.079097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1019/2025] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:45 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:46.083586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.094091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0657fba-94fd-4197-b915-8204e37c509b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.120304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:46.154294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.154926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.155200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.155468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.156155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.158170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.172988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.172988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:46.188447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a511-59de-4547-990f-316e5ad9eb68 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.195439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.199212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.199212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.199212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] PATH_INFO: `/v3/projects/ad24092f5b194b92a3665f8cf240342b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.199212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad24092f5b194b92a3665f8cf240342b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.201138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.341118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1007/2026] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:46 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:46.342409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.352460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3840d-7c86-4448-883a-ec66d8d8fda0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.358067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.359074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.359373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.360284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.360940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.362602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.383556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1008/2027] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:46.383556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.389665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafbb7-863f-4cee-a10f-d29e9eebd45a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.397178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad24092f5b194b92a3665f8cf240342b', 'request_id': 'req-b148b971-e3ee-4d42-903e-82a797b35ba5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.411587 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:46.448776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.449428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.449680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.449953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.450590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.451159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad24092f5b194b92a3665f8cf240342b', 'request_id': 'req-b148b971-e3ee-4d42-903e-82a797b35ba5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.452227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.458515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad24092f5b194b92a3665f8cf240342b', 'request_id': 'req-b148b971-e3ee-4d42-903e-82a797b35ba5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.463081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1009/2028] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:46.467142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.474973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] The token cache is being invalidate because project ad24092f5b194b92a3665f8cf240342b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:46.475193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.475890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.477500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1020/2029] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:46 2022] DELETE /identity/v3/projects/ad24092f5b194b92a3665f8cf240342b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:46.478972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa7e6-45f1-4fe2-9c8c-56dc2e547ac4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.485356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.485356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.485356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.485356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] PATH_INFO: `/v3/projects/7d728d5a2ad44dd6858c39a179b71ea7/users/b38286b1b61f43a88b07fa3cbcbaf556/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.487471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.489051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:46.500389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d728d5a2ad44dd6858c39a179b71ea7, user_id=b38286b1b61f43a88b07fa3cbcbaf556, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.502196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148b971-e3ee-4d42-903e-82a797b35ba5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.503342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d661448-d0ec-488a-939b-04632b5b7503 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.507143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.512366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.512366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.512366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] PATH_INFO: `/v3/users/4241ddcab17b4b31930ebdfc20e960a6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.512366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4241ddcab17b4b31930ebdfc20e960a6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.512366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.622950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1010/2030] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:46 2022] PUT /identity/v3/projects/7d728d5a2ad44dd6858c39a179b71ea7/users/b38286b1b61f43a88b07fa3cbcbaf556/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:46.634576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.640778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.640778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.663248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] MFA Rules not processed for user `b38286b1b61f43a88b07fa3cbcbaf556`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:46.664478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:46.729420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1011/2031] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:46.742907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4241ddcab17b4b31930ebdfc20e960a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.743561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4241ddcab17b4b31930ebdfc20e960a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.743691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:46.745047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:46.756581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4241ddcab17b4b31930ebdfc20e960a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.801742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abac11-1e04-43d9-b9e2-3b439b41efeb None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:46.805391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:46.811187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:46.811187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:46.811187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:46.811187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:46.819735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:46.821191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:46.829967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1012/2032] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:46.877076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4241ddcab17b4b31930ebdfc20e960a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.885817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81a27999-c378-441c-b0ed-eb1e514dffdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4241ddcab17b4b31930ebdfc20e960a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:46.894082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1021/2033] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:46 2022] DELETE /identity/v3/users/4241ddcab17b4b31930ebdfc20e960a6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:47.345400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:47.347038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:47.437854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a42b-02a3-4e03-b6d4-fffb17940a23 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:47.497103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:47.502446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:47.502446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:47.502446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] PATH_INFO: `/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:47.502446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a6b4828ba9481eaa8fdd800e64f977)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:47.502446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:47.660257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a6b4828ba9481eaa8fdd800e64f977', 'request_id': 'req-fad67926-ee71-422c-8670-5a44be0399db'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:47.666971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a6b4828ba9481eaa8fdd800e64f977', 'request_id': 'req-fad67926-ee71-422c-8670-5a44be0399db'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:47.793956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a6b4828ba9481eaa8fdd800e64f977', 'request_id': 'req-fad67926-ee71-422c-8670-5a44be0399db'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:47.806645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] The token cache is being invalidate because project c1a6b4828ba9481eaa8fdd800e64f977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:47.807063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:47.807937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-fad67926-ee71-422c-8670-5a44be0399db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:47.810207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1013/2034] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:47 2022] DELETE /identity/v3/projects/c1a6b4828ba9481eaa8fdd800e64f977 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:47.815603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44285759-d2f6-42c9-801f-84670c927107 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:47.816125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44285759-d2f6-42c9-801f-84670c927107 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:47.816332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44285759-d2f6-42c9-801f-84670c927107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:47.836390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-44285759-d2f6-42c9-801f-84670c927107 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:47.837579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-44285759-d2f6-42c9-801f-84670c927107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:47.895666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1022/2035] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:47.903740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:47.904070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:47.904357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:47.905670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:47.929782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:47.931001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:47.939225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1014/2036] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:47.951559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44285759-d2f6-42c9-801f-84670c927107 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:47.962471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44285759-d2f6-42c9-801f-84670c927107 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:47.967662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:47.968299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:47.968724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:47.969003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:47.969650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:47.969950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:47.972214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:47.984372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1023/2037] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:47.989341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:47.998418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dfa82-5181-4457-9a23-31ddf2742cce None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.007679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.009311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.009311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.009311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.009634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.011467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.099624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1015/2038] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:48.103829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.114703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ab71-6b7a-4a7d-a277-ba994d32ac3d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.171574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.172235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.172512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.172781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.173399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.176453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.289106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1024/2039] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:48 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:48.292884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.304743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd3363-0275-42fe-b75b-add0074aeb5e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.310227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:48.311146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.311822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.312132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.320044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.320044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.320044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.325485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1016/2040] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:48.329532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.340123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5193-f91e-4aa8-8429-412e96d7e778 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.345037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.351730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.352059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.352339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.354995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.354995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf20a9-9032-49ba-a69b-7114b2aa3c4f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.367009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1025/2041] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:48.371124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.381154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570c68d-fe56-48be-bbc7-705b16eb3849 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.387044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.387044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.387044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.387044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] PATH_INFO: `/v3/projects/f4f9fc1a41bf466aaf41d80bc6e8462e/users/5321392b483844b6ada66a436712e948/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.401545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f9fc1a41bf466aaf41d80bc6e8462e, user_id=5321392b483844b6ada66a436712e948, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.404252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.482429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1017/2042] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:48 2022] PUT /identity/v3/projects/f4f9fc1a41bf466aaf41d80bc6e8462e/users/5321392b483844b6ada66a436712e948/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:48.493946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.494257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.494526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.522221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] MFA Rules not processed for user `5321392b483844b6ada66a436712e948`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:48.523418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:48.623581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1026/2043] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:48.628290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.700520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37350a9-3eec-4bf5-aa0a-e86bada7e2a4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.707144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.707769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.712464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.712464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.712464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.712464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:48.842650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1018/2044] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:48.845234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:48.855723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5af72e-7857-43a8-bf01-c049fa7dd11a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:48.912152 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:48.913093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:48.913387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:48.913654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:48.914281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:48.916310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.056360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1027/2045] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:48 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:49.058867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.070679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b40de6-7d8e-41af-9594-0f0daafc6095 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.076614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.077283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.077565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.077836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.078484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.080976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.092594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1019/2046] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:49.105636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.112105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d089-d91c-4d72-9d85-6c64dd872e5f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.116769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.117417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.117690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.117962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] PATH_INFO: `/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac/users/87f29c3925ed49d8998dd37819077c55/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.133141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0588ed896ac444d0bedd15fc07ffc8ac, user_id=87f29c3925ed49d8998dd37819077c55, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.135849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.209130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1028/2047] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:49 2022] PUT /identity/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac/users/87f29c3925ed49d8998dd37819077c55/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:49.215344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.230762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad9d50-0cc4-4288-b60c-fff5af3e8577 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.287517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.288079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.288362 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.288634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.289272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.290854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd5f7e-155a-491f-91ff-a50dd9c2a6c6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.294208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:49.307016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1020/2048] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:49.311335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.326871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a631a3c-5f09-45ff-9df4-4dc3fafa14b5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.328406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.328955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.329231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.329502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] PATH_INFO: `/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac/users/87f29c3925ed49d8998dd37819077c55/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.332576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0588ed896ac444d0bedd15fc07ffc8ac, user_id=87f29c3925ed49d8998dd37819077c55, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.335203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.347130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1029/2049] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:49 2022] PUT /identity/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac/users/87f29c3925ed49d8998dd37819077c55/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:49.357368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.357650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.357923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.385879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] MFA Rules not processed for user `87f29c3925ed49d8998dd37819077c55`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:49.387074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:49.438927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:49.466397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1021/2050] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:49.496577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.498329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:49.500596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:49.502546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:49.568935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175ffb-c6d7-4866-8cb3-3ba03c194223 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.573229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.573912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.578283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.578283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.587710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa101-1ff5-424f-907b-1f5465684c3c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:49.592805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:49.593433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.593707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.593973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] PATH_INFO: `/v3/users/3919d2ac09564166beff4d7b1306dbb2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.595123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3919d2ac09564166beff4d7b1306dbb2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.597121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.636967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:49.638487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436ae2-8598-4e6b-869d-5ac0c6dc8117 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:49.649082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1022/2051] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:49.837672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3919d2ac09564166beff4d7b1306dbb2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:49.838427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3919d2ac09564166beff4d7b1306dbb2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:49.852136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3919d2ac09564166beff4d7b1306dbb2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:49.900593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:49.927569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3919d2ac09564166beff4d7b1306dbb2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:49.937730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3919d2ac09564166beff4d7b1306dbb2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:49.943013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1030/2052] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:49 2022] DELETE /identity/v3/users/3919d2ac09564166beff4d7b1306dbb2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:49.948134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:49.948681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:49.949166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:49.973570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:49.975017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.036303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1023/2053] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:50.049824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:50.052586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.120789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef210528-5fb1-4473-8b4e-1413470846f6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:50.124478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:50.125092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.125717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.125717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.135741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:50.137268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:50.156061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1031/2054] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:50.174150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:50.302463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:50.304548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.330786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42532882-2132-490b-bdf3-7bcf601dbf59 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:50.336680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:50.338094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.338536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.339903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] PATH_INFO: `/v3/users/b38286b1b61f43a88b07fa3cbcbaf556` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.340693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38286b1b61f43a88b07fa3cbcbaf556)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:50.342841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:50.414690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:50.616398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:50.617912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.624438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38286b1b61f43a88b07fa3cbcbaf556'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.625253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38286b1b61f43a88b07fa3cbcbaf556'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.633874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38286b1b61f43a88b07fa3cbcbaf556'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.635869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6372c41-152b-4ec3-9e46-7d80b89dd271 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:50.642937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:50.643862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.644266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.644611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] PATH_INFO: `/v3/projects/35b48c18ba144e92bea950201bf46001` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.645829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b48c18ba144e92bea950201bf46001)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:50.647726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:50.731079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38286b1b61f43a88b07fa3cbcbaf556'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.744517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-209ffe07-c7da-46b7-a46f-febc4120318d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38286b1b61f43a88b07fa3cbcbaf556'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.750360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1024/2055] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:50 2022] DELETE /identity/v3/users/b38286b1b61f43a88b07fa3cbcbaf556 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:50.755400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.755701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.755987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.776155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:50.777351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.785174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b48c18ba144e92bea950201bf46001', 'request_id': 'req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.838072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1025/2056] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:50.848072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:50.849423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.881588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b48c18ba144e92bea950201bf46001', 'request_id': 'req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.888547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b48c18ba144e92bea950201bf46001', 'request_id': 'req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.899467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] The token cache is being invalidate because project 35b48c18ba144e92bea950201bf46001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:50.899759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.900422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a68f15f-b3f6-4d64-95cc-ed2d9d76fe3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:50.901952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1032/2057] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:50 2022] DELETE /identity/v3/projects/35b48c18ba144e92bea950201bf46001 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:50.906552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244c06-ac86-4d32-85be-32f14f67c928 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.906812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244c06-ac86-4d32-85be-32f14f67c928 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.907085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244c06-ac86-4d32-85be-32f14f67c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.909523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1db5dc-eff5-4dd2-928a-783c9a36880c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:50.913274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:50.919279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.919279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.919279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.919279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.927524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8b244c06-ac86-4d32-85be-32f14f67c928 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:50.928758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8b244c06-ac86-4d32-85be-32f14f67c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.929528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:50.931014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:50.936763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1033/2058] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:50.943907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1026/2059] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:50.946939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:50.947208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:50.947480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:50.967656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:50.968883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:50.978569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1034/2060] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:50.982586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:50.994239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b671dc-a863-4b56-b282-41018915fe6b service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:50.999137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:50.999735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.000317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.000738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.001550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:51.002049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.003881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.019572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:51.038173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1027/2061] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:51.042893 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.053663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952cd8-99e3-481c-944f-fd01de7ac87c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.058950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.059638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.060034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.060350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.061327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.063665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.156865 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1035/2062] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:51.157802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.173375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b977-6ec9-47fe-9511-29cdfa8ea0e2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.250016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.250630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.250907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.251179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.252189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.254215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.389078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1028/2063] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:51.393654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.404167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1814-3080-4d4a-90c0-949ea49c598f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.409932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.410619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.410978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.411273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.412106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.414345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.420980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.426478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:51.429977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1036/2064] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:51.434585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.443135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512fdd-b012-4bef-b959-de1fec75bfc4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.447901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5974d-dde5-49b8-a781-488136b36953 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.456209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.457188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.460760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.460760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.460760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.461005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.461264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.462017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.462374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.462644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] PATH_INFO: `/v3/projects/7d728d5a2ad44dd6858c39a179b71ea7` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.463867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d728d5a2ad44dd6858c39a179b71ea7)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.466127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.480997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1037/2065] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:51.490316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.504516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21c34-1304-49da-8389-fe2943f748d0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.510626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.512580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.512580 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.512841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] PATH_INFO: `/v3/projects/8b27e8e1130e41ada6ccc2c9c4081ed3/users/7b1972ff6d0b4116b77e9411ff22f359/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.531562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b27e8e1130e41ada6ccc2c9c4081ed3, user_id=7b1972ff6d0b4116b77e9411ff22f359, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.535276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab21e9-20a6-4311-8139-828b0150e67a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.657061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1038/2066] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:51 2022] PUT /identity/v3/projects/8b27e8e1130e41ada6ccc2c9c4081ed3/users/7b1972ff6d0b4116b77e9411ff22f359/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:51.659374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.659659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.659956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.666077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d728d5a2ad44dd6858c39a179b71ea7', 'request_id': 'req-812f17b4-820a-437e-8287-1af167af639c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:51.673515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d728d5a2ad44dd6858c39a179b71ea7', 'request_id': 'req-812f17b4-820a-437e-8287-1af167af639c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:51.687989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] MFA Rules not processed for user `7b1972ff6d0b4116b77e9411ff22f359`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:51.689197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:51.753512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1039/2067] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:51.757873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.761971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d728d5a2ad44dd6858c39a179b71ea7', 'request_id': 'req-812f17b4-820a-437e-8287-1af167af639c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:51.775232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] The token cache is being invalidate because project 7d728d5a2ad44dd6858c39a179b71ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:51.775528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:51.776324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-812f17b4-820a-437e-8287-1af167af639c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:51.777843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1029/2068] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:51 2022] DELETE /identity/v3/projects/7d728d5a2ad44dd6858c39a179b71ea7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:51.782736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.783082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.783356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.802694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:51.803907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:51.836491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b331-dfb1-4c2a-afdc-b8ad8e578116 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.841392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.842080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.842361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.842630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.843408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.845560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115a6c2-9a73-40e9-9c87-123b8cf3a09b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.877199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1030/2069] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:51.878641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:51.879975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:51.891624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239cb8-dd4c-42c4-9569-a1a066fddd8a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:51.897209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:51.897828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.898109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.898379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] PATH_INFO: `/v3/users/7a58bd76a9d645e88a7ef8a10a8f6b85` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.899506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a58bd76a9d645e88a7ef8a10a8f6b85)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:51.901452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:51.975055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1040/2070] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:51.976526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:51.976802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:51.977077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:51.997043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:51.998373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.057839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1041/2071] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:52.058813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.060087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.073015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641693a2-6364-4103-a7a3-2838a729a0b8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.085100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.085740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.085990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.086253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.086889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.089232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.110911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a58bd76a9d645e88a7ef8a10a8f6b85'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:52.112138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a58bd76a9d645e88a7ef8a10a8f6b85'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:52.118977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a58bd76a9d645e88a7ef8a10a8f6b85'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:52.196497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a58bd76a9d645e88a7ef8a10a8f6b85'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:52.203362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1042/2072] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:52.204244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.208524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.215367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a58bd76a9d645e88a7ef8a10a8f6b85'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:52.221474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25e4b-8c41-48eb-bd0b-9dcd4f2c1e93 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.222493 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1031/2073] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:51 2022] DELETE /identity/v3/users/7a58bd76a9d645e88a7ef8a10a8f6b85 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:52.223677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.226371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.290186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.290805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.291084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.291357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.292167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:52.292501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.294104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142439d-2ebc-4860-8626-5836cd656d24 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.305593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4dc5-7021-4a01-b4e6-a2dfecaa672f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.311982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1043/2074] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:52.313636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.314057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.317518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.317649 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.317733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.317733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.317733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.318307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.320727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.333269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1032/2075] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:52.334325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.338911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:52.341204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.344692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203ad1e-f418-42b6-ad74-4cf17fed36cc admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.349478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.350110 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.350385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.350653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.351275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.351982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1044/2076] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:52.353281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.353850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.364450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59d14-095d-4bf4-9b3e-e0a31a3e47a4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.369969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.370912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.371257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.371529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.372663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.374022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.385632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1045/2077] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:52.386641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.388664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.445190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1033/2078] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:52.445190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.446644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65700b4-34f5-42d9-a416-4a5a6bf36eaa admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.464178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:52.498065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.498609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.498866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.499126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.509933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c54a4-884c-4d75-abe8-6466148e777f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.514771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.515425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.515701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.516009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] PATH_INFO: `/v3/projects/e08fcacdd4d44416a4d52d95f204ee7d/users/eacebde57ae14933be6ba0b5730d70a5/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.523054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:52.530734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08fcacdd4d44416a4d52d95f204ee7d, user_id=eacebde57ae14933be6ba0b5730d70a5, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.533949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164db5f-71aa-406b-9551-536690098f27 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.572328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.575551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.584406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1046/2079] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:52.585265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.594877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1436-dd6d-4587-b1a7-f24dae8c847e service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.600610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.601214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.601689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.601946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.602576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.604598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.629221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1034/2080] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:52 2022] PUT /identity/v3/projects/e08fcacdd4d44416a4d52d95f204ee7d/users/eacebde57ae14933be6ba0b5730d70a5/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:52.639556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.639874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.640156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.668659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] MFA Rules not processed for user `eacebde57ae14933be6ba0b5730d70a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:52.670045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:52.734441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1035/2081] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:52.739976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.800650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda9845-7574-4a13-84d2-4a003eeb685c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.805845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.806481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.806760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.807028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.807640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.809564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.830149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1047/2082] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:52.831665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.842444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd9fe-1c7e-4ffe-9656-1bf647fe300c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.848269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.848872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.849147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.849416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.850104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.851806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.863093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1048/2083] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:52.866787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.878497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cba99-3006-4134-aa5e-a6376de9dfc6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.883279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:52.884430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:52.884430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:52.884765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:52.885263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:52.886878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:52.902279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1049/2084] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:52.909185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.914528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1036/2085] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:52.918591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:52.934220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7851eb4-bc24-4865-ab2d-0ac9c7c4486e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:52.992224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ecbc-2d7b-4ac3-a560-b6371db37420 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.000198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.000198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.000575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.000948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.001677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.001843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.002388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.004474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.004612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.004770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] PATH_INFO: `/v3/projects/db6adb1ee14044b68a86f4909ffe4268/users/319cd6ea1e824adcb45d47b0db9b2e45/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.027130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6adb1ee14044b68a86f4909ffe4268, user_id=319cd6ea1e824adcb45d47b0db9b2e45, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.029803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.105017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1050/2086] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:52 2022] PUT /identity/v3/projects/db6adb1ee14044b68a86f4909ffe4268/users/319cd6ea1e824adcb45d47b0db9b2e45/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:53.105928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.107504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.112176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1037/2087] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:52 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:53.113040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.125774 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.141648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170596-8a03-4014-a67c-8ad2dbf3a529 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.190669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73696de-ab8a-4a46-8134-18e93b596fd6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.195442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.196160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.196622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.196779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] PATH_INFO: `/v3/users/6229e66d21a4435b953bf789360e29ff` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.197912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6229e66d21a4435b953bf789360e29ff)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.199888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.200455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.201302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.201475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.201749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] PATH_INFO: `/v3/projects/c280864957b44f9389a9cd4e5c45a7be` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.202878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c280864957b44f9389a9cd4e5c45a7be)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.206580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.379252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c280864957b44f9389a9cd4e5c45a7be', 'request_id': 'req-af752fc1-8379-4529-bde3-3b871bfb1ff9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.379436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6229e66d21a4435b953bf789360e29ff'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.380108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6229e66d21a4435b953bf789360e29ff'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.385651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c280864957b44f9389a9cd4e5c45a7be', 'request_id': 'req-af752fc1-8379-4529-bde3-3b871bfb1ff9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.393077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6229e66d21a4435b953bf789360e29ff'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.464750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c280864957b44f9389a9cd4e5c45a7be', 'request_id': 'req-af752fc1-8379-4529-bde3-3b871bfb1ff9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.476335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] The token cache is being invalidate because project c280864957b44f9389a9cd4e5c45a7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:53.476633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.477296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.478820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1038/2088] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:53 2022] DELETE /identity/v3/projects/c280864957b44f9389a9cd4e5c45a7be => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:53.479616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.480925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.550172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752fc1-8379-4529-bde3-3b871bfb1ff9 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.554956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.555553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.555852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.556118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.556760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.558338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a97f9-5940-4e17-ad36-686f52fe2c0e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.567399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6229e66d21a4435b953bf789360e29ff'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.568422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1039/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:53.569618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6b15-9465-4be2-acbe-c5c140d6322b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.569938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6b15-9465-4be2-acbe-c5c140d6322b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.570208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6b15-9465-4be2-acbe-c5c140d6322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.575935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6229e66d21a4435b953bf789360e29ff'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:53.582632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1051/2090] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:53 2022] DELETE /identity/v3/users/6229e66d21a4435b953bf789360e29ff => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:53.583587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.585366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.600293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8dab6b15-9465-4be2-acbe-c5c140d6322b None None] MFA Rules not processed for user `319cd6ea1e824adcb45d47b0db9b2e45`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:53.601532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8dab6b15-9465-4be2-acbe-c5c140d6322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.645545 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099b78-6136-4198-9402-d45931e78f77 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.649221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.650015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.650293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.650562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.652302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.666190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1040/2091] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:53.667675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff41daf-cc68-40d9-a76d-559be0fc316b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.668050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff41daf-cc68-40d9-a76d-559be0fc316b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.668387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff41daf-cc68-40d9-a76d-559be0fc316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.690270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-dff41daf-cc68-40d9-a76d-559be0fc316b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:53.691484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-dff41daf-cc68-40d9-a76d-559be0fc316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.717661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.719168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.729676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1052/2092] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:53.730421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.756199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1041/2093] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:53.757483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.759135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.759135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.780047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:53.781241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.789910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1042/2094] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:53.793994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.795252 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e426d13-2bc8-4135-ad65-e7f284af0de7 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.795949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.800282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.800932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.801206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.801469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] PATH_INFO: `/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1/users/0e35ea0e74364c9c8bffc3fc817188e9/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.807070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:53.810483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79b5b7-4597-4d10-a13f-10a53f14cf88 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.814152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.814924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.815247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.815513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.816909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33e9ba5eda444ee861c3b5b6a53ebe1, user_id=0e35ea0e74364c9c8bffc3fc817188e9, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.819736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.824236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:53.825659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c685-6ed2-4f56-8e3f-340fb463b9c0 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:53.835797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1043/2095] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:53.839569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.839569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.839569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.857388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:53.858570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.867552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1044/2096] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:53.868272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.871005 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:53.888269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:53.907500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1053/2097] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:53 2022] PUT /identity/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1/users/0e35ea0e74364c9c8bffc3fc817188e9/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:53.912204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:53.953498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1b0b-9c68-417b-b305-34a2418b6991 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.992080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13085c0-dad1-447d-9713-b10efde61ba5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:53.997065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:53.997785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:53.998062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:53.998331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:53.999121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:53.999422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.001043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.005516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.006135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.006410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.006677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.013234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1054/2098] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:41:54.014049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.016129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.018523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.026881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ae7c-4901-4556-b834-f2eb255280b5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.028543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1045/2099] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:54.029576 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.032737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.033666 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.034052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.035032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.035147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.036806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.040195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca685eb-e0e4-44c6-8b84-81f5cecd4c46 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.046413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.047150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.047549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.047980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.048713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.050798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1055/2100] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:54.054459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.054589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.077031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c122-8af2-4e90-b865-72f691f25b65 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.086074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.087237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.087894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.088237 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] PATH_INFO: `/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1/users/0e35ea0e74364c9c8bffc3fc817188e9/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.091822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33e9ba5eda444ee861c3b5b6a53ebe1, user_id=0e35ea0e74364c9c8bffc3fc817188e9, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.094877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d2b4f-b805-4bf8-9ef9-8f4a0f581288 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.107838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1056/2101] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:54 2022] PUT /identity/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1/users/0e35ea0e74364c9c8bffc3fc817188e9/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:54.119426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.120132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.126535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.151817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] MFA Rules not processed for user `0e35ea0e74364c9c8bffc3fc817188e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:54.155181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:54.182407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1046/2102] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:54 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:54.186463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.223568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1057/2103] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:54.249700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148f5e-c5c1-4582-abc2-db2c3121e6ec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.255268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.255901 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.256181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.256480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.257097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.261483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.376115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:54.385341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1047/2104] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:54 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:54.389358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.453539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a7847-101f-4033-85ba-184f2d4029d1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.458537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.459141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.459418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.459687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.460363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.461954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.471842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1058/2105] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:41:54.475958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.485835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1090-83d6-45d8-9e6a-de1c21bc54b7 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.491329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.491957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.492238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.492506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.493142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.494726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.506277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1048/2106] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:54.510395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.520642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281adcc-d6a8-460e-9030-b8178fd076ff admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.525609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.526266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.526532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.526803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] PATH_INFO: `/v3/projects/a47c7d1dfe0e491bb3969edb187b8dd5/users/f232149919c24623a12e55296e0c6e04/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.541700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.544918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:54.551499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47c7d1dfe0e491bb3969edb187b8dd5, user_id=f232149919c24623a12e55296e0c6e04, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.554379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.632483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95c5a-b365-4561-9373-d7da5bb46b9f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.636470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.637087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.637364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.637639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.639426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:54.665737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1059/2107] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:54 2022] PUT /identity/v3/projects/a47c7d1dfe0e491bb3969edb187b8dd5/users/f232149919c24623a12e55296e0c6e04/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:54.668011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.675818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:54.713507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:54.740849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:54.747838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.749224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496732c-429e-4e3a-8c0b-b196674cc5ad service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.758424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3400fa-b62d-4e55-958f-a7f618457ab3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.759360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1049/2108] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:54.760978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.761328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.761671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.764600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47345435-b21b-4819-b117-6347831774ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.765221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47345435-b21b-4819-b117-6347831774ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.765510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47345435-b21b-4819-b117-6347831774ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.765879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47345435-b21b-4819-b117-6347831774ad admin admin] PATH_INFO: `/v3/projects/f039dcb432f748b58cd62fd7c052fe5e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:54.767073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47345435-b21b-4819-b117-6347831774ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f039dcb432f748b58cd62fd7c052fe5e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:54.777852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47345435-b21b-4819-b117-6347831774ad admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:54.792935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] MFA Rules not processed for user `f232149919c24623a12e55296e0c6e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:54.794276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:54.862004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1050/2109] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:54.873477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:54.922115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f039dcb432f748b58cd62fd7c052fe5e', 'request_id': 'req-47345435-b21b-4819-b117-6347831774ad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:54.929054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292179f7-e461-4742-a6b1-e301d551bb3d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:54.976931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:54.977463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:54.977763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:54.978026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:55.003948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f039dcb432f748b58cd62fd7c052fe5e', 'request_id': 'req-47345435-b21b-4819-b117-6347831774ad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.011151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f039dcb432f748b58cd62fd7c052fe5e', 'request_id': 'req-47345435-b21b-4819-b117-6347831774ad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.021996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] The token cache is being invalidate because project f039dcb432f748b58cd62fd7c052fe5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:55.022604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.022940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.024557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1060/2110] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:54 2022] DELETE /identity/v3/projects/f039dcb432f748b58cd62fd7c052fe5e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:55.028568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:55.030050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:55.034745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:55.036302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:55.045743 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1051/2111] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:55.073248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:55.096906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47345435-b21b-4819-b117-6347831774ad admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:55.102231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:55.102860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:55.103134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:55.103400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] PATH_INFO: `/v3/users/7858ee235c224ff3bd193460d62207b4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:55.105284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7858ee235c224ff3bd193460d62207b4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:55.108887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:55.143842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b7f7-115e-46aa-980d-66929133ad70 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:55.149203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:55.149825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:55.150101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:55.150370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] PATH_INFO: `/v3/users/f232149919c24623a12e55296e0c6e04` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:55.151496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f232149919c24623a12e55296e0c6e04)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:55.153605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:55.346966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7858ee235c224ff3bd193460d62207b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.347686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7858ee235c224ff3bd193460d62207b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.359776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7858ee235c224ff3bd193460d62207b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.373321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f232149919c24623a12e55296e0c6e04'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.373960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f232149919c24623a12e55296e0c6e04'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.381043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f232149919c24623a12e55296e0c6e04'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.447356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7858ee235c224ff3bd193460d62207b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.448153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:55.456249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8534b05c-9a1d-4272-847b-5b62acf68d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7858ee235c224ff3bd193460d62207b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.462562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1061/2112] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:55 2022] DELETE /identity/v3/users/7858ee235c224ff3bd193460d62207b4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:55.533811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f232149919c24623a12e55296e0c6e04'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.536903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:55.554289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f232149919c24623a12e55296e0c6e04'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:55.568345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1052/2113] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:55 2022] DELETE /identity/v3/users/f232149919c24623a12e55296e0c6e04 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:55.572930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:55.573215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:55.573487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:55.595137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:55.596675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:55.665142 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1062/2114] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:55.676049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:55.677473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:55.752543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742dce6-bf2e-4379-adc3-d2852e7c61cb admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:55.757304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:55.758347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:55.758976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:55.759250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:55.773254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:55.774717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:55.787947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1053/2115] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:55.849025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:56.026169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.027583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.043078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530fe95-bcec-4a7f-87a9-5b8882687cd8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.054680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.055972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.056638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.056979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] PATH_INFO: `/v3/projects/19011edb29be4b19ac8dbda39d48c368` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.058481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19011edb29be4b19ac8dbda39d48c368)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.061402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.252442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19011edb29be4b19ac8dbda39d48c368', 'request_id': 'req-e458c703-5860-4087-a4e8-540a92741913'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.319660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.321754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.338819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19011edb29be4b19ac8dbda39d48c368', 'request_id': 'req-e458c703-5860-4087-a4e8-540a92741913'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.341125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0baec-7485-4fa1-b3c2-2105d18e8ee8 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.347157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19011edb29be4b19ac8dbda39d48c368', 'request_id': 'req-e458c703-5860-4087-a4e8-540a92741913'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.358638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] The token cache is being invalidate because project 19011edb29be4b19ac8dbda39d48c368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:56.358929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.359609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e458c703-5860-4087-a4e8-540a92741913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.361192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1063/2116] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:56 2022] DELETE /identity/v3/projects/19011edb29be4b19ac8dbda39d48c368 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:56.367713 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a2b1-761b-4380-a7cf-a63b8b458dec None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.368032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a2b1-761b-4380-a7cf-a63b8b458dec None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.368313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a2b1-761b-4380-a7cf-a63b8b458dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.388180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-93c8a2b1-761b-4380-a7cf-a63b8b458dec None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:56.389520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-93c8a2b1-761b-4380-a7cf-a63b8b458dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.404631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.405288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.405566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.405979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] PATH_INFO: `/v3/projects/a47c7d1dfe0e491bb3969edb187b8dd5` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.407242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47c7d1dfe0e491bb3969edb187b8dd5)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.410030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.453068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1064/2117] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:56.461984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.462266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.462535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.482261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:56.483776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.495380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1065/2118] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:41:56.496726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.507307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f4739-4e93-4581-862e-dffc1808b3ae None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.512685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.512825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.518273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.518273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.518273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:41:56.518273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.518273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.519994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:56.536178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1066/2119] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:41:56.541499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.547358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb9d66-48e3-4f1e-bdbf-d817c1b54dc2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.549475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47c7d1dfe0e491bb3969edb187b8dd5', 'request_id': 'req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.556101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47c7d1dfe0e491bb3969edb187b8dd5', 'request_id': 'req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.606877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.607476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.607756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.608058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.608677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.610621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.656910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47c7d1dfe0e491bb3969edb187b8dd5', 'request_id': 'req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.668411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] The token cache is being invalidate because project a47c7d1dfe0e491bb3969edb187b8dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:56.668706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.669351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:56.670846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1054/2120] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:56 2022] DELETE /identity/v3/projects/a47c7d1dfe0e491bb3969edb187b8dd5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:56.745317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1067/2121] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:56 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:56.747027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.748501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.762693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2c6c-9c32-4e58-adcf-5f589f8815bc admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.826321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.827855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.861875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.862890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.863175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.863447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.864145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.866105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.899897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf5f74-b525-4304-ad20-b95e8766c117 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:56.903591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:56.904217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:56.904490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:56.904754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:56.906616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:56.969460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:56.972046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:56.981521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1055/2122] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:56 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:41:56.982570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1068/2123] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:56.985777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:56.998179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925321-a60b-4def-a08e-c4ad0e6ece7b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.003378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.004192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.004570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.005219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.007444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.007853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.019316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1056/2124] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:57.023328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.036894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b1c0d-4aaa-4aa5-a2f9-bacbac220be0 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.041927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.042942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.046082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.046082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.046082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.046082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eac25-496f-4011-a4ab-652fb510a0c3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.061475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1069/2125] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:57.062625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.073248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f222-e087-4d71-91c7-251b575333e4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.079163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.079898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.080193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.080754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] PATH_INFO: `/v3/projects/3e756e804a54497d8651e1b7d1530ba1/users/59da93551c934789a25046ad03a75aaf/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.101602 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e756e804a54497d8651e1b7d1530ba1, user_id=59da93551c934789a25046ad03a75aaf, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.106062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.220181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1057/2126] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:57 2022] PUT /identity/v3/projects/3e756e804a54497d8651e1b7d1530ba1/users/59da93551c934789a25046ad03a75aaf/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:57.231755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.232100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.232390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.261165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] MFA Rules not processed for user `59da93551c934789a25046ad03a75aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:57.262374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:57.304807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:57.342943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1070/2127] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:57.347812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.426790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5504-b941-4a06-aab4-b1cb06071385 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.433259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.433968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.434246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.434513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.435148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.437142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.593307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1058/2128] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:41:57 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:57.598508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.609753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ad7d-4edd-4534-a75e-31bd21626706 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.686565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.688245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.688526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.689798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.690522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.692494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.812137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1071/2129] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:41:57 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:41:57.819082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.834932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa465e-c407-430d-ad0b-5b579125c664 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.839666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.841713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.841995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.842267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.842920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.848322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:57.869698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1059/2130] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:57.874184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:57.885462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f8c2-35e6-4fa6-9c89-7eaca8d1238d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:57.891558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:57.892295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:57.893189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:57.893494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] PATH_INFO: `/v3/projects/cbe61b722d2e4d03aed80e1efead85a4/users/08ef116b51064df38512627706c30a93/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:57.916121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe61b722d2e4d03aed80e1efead85a4, user_id=08ef116b51064df38512627706c30a93, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:57.922463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.014189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1072/2131] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:57 2022] PUT /identity/v3/projects/cbe61b722d2e4d03aed80e1efead85a4/users/08ef116b51064df38512627706c30a93/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:58.021884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:58.032593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afc4a-94a8-43d6-9833-159e7dc69fab admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:58.083391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:58.094531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:58.095168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.095454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.095716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.096393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:58.099053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb8c1-66ba-4cc8-8225-6b8bb9739b23 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.109891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1060/2132] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:41:58.114622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:58.126361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fe9a-46af-4c5a-8e42-f04d9ebed75b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:58.132396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:58.133055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.133337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.133614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] PATH_INFO: `/v3/projects/cbe61b722d2e4d03aed80e1efead85a4/users/08ef116b51064df38512627706c30a93/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.135531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe61b722d2e4d03aed80e1efead85a4, user_id=08ef116b51064df38512627706c30a93, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:58.138716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.149925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1073/2133] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:41:58 2022] PUT /identity/v3/projects/cbe61b722d2e4d03aed80e1efead85a4/users/08ef116b51064df38512627706c30a93/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:58.162865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.163233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.163507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.194106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] MFA Rules not processed for user `08ef116b51064df38512627706c30a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:58.195489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:58.260332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:58.272288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1061/2134] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:58.344677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:58.346584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:58.406224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaffc47-8978-4678-b0bf-ba810ecf73a3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:58.409845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:58.410454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.410731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.411001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.420272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:58.421708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.431721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1074/2135] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:58.462563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:58.527958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:58.528489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421585b3-3b54-4f7b-8cad-b43c964598ff None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:58.534043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:58.534673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.534948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.535217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] PATH_INFO: `/v3/users/59da93551c934789a25046ad03a75aaf` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.536399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59da93551c934789a25046ad03a75aaf)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:58.538358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.778481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59da93551c934789a25046ad03a75aaf'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:58.779241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59da93551c934789a25046ad03a75aaf'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:58.792318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59da93551c934789a25046ad03a75aaf'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:58.870331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:58.876448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59da93551c934789a25046ad03a75aaf'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:58.881927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d667f5-b6b9-4f31-8d16-fced540a71ea service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:58.885875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:58.886625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.887422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.887422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.889034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:58.889925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-05613736-821a-499d-a405-aac9a9b73218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59da93551c934789a25046ad03a75aaf'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:58.896924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1062/2136] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:58 2022] DELETE /identity/v3/users/59da93551c934789a25046ad03a75aaf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:41:58.901545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:58.901843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:58.902121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:58.921581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:58.922933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:58.957949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:58.959458 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:58.977765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1075/2137] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:58.991195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1063/2138] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:59.001846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:59.003407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:59.061703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86ee-7fbc-46b4-8ef4-6fc014d6e434 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:59.119127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:59.119773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:59.120087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:59.120366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:59.129840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:59.131286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:59.140798 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1076/2139] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:59.254202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:59.395084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=75,keystone:DELETE=21,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:59.599564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:59.661444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:59.662993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:59.677043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd51754-044d-4417-8af6-eb58791e56c2 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:59.682611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:59.683297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:59.683604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:59.683978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] PATH_INFO: `/v3/projects/3e756e804a54497d8651e1b7d1530ba1` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:59.685615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e756e804a54497d8651e1b7d1530ba1)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:59.690713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:59.832210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e756e804a54497d8651e1b7d1530ba1', 'request_id': 'req-944307fe-f57a-4aa8-9243-373162073530'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:59.839074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e756e804a54497d8651e1b7d1530ba1', 'request_id': 'req-944307fe-f57a-4aa8-9243-373162073530'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:59.925793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e756e804a54497d8651e1b7d1530ba1', 'request_id': 'req-944307fe-f57a-4aa8-9243-373162073530'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:59.936947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] The token cache is being invalidate because project 3e756e804a54497d8651e1b7d1530ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:41:59.937237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:59.937887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:41:59.940410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1064/2140] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:41:59 2022] DELETE /identity/v3/projects/3e756e804a54497d8651e1b7d1530ba1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:41:59.944550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:59.954325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7026-d58a-4daa-ae49-25af9746441f service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:00.014140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:00.014950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:00.015320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:00.015613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] PATH_INFO: `/v3/users/08ef116b51064df38512627706c30a93` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:00.016843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ef116b51064df38512627706c30a93)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:00.018819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:00.245748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ef116b51064df38512627706c30a93'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:00.246497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ef116b51064df38512627706c30a93'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:00.261053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ef116b51064df38512627706c30a93'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:00.337079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ef116b51064df38512627706c30a93'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:00.337396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:00.347703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7ec363c6-e4b4-43c7-8204-3b675e546304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ef116b51064df38512627706c30a93'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:00.354026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1077/2141] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:41:59 2022] DELETE /identity/v3/users/08ef116b51064df38512627706c30a93 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:00.499166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:00.836069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:00.837557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:00.851770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944307fe-f57a-4aa8-9243-373162073530 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:00.910009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:00.910811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:00.911087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:00.911352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] PATH_INFO: `/v3/projects/cbe61b722d2e4d03aed80e1efead85a4` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:00.912503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe61b722d2e4d03aed80e1efead85a4)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:00.914390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.054311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe61b722d2e4d03aed80e1efead85a4', 'request_id': 'req-9c9a6595-459c-41ca-9d32-1cf67968c44b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:01.060968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe61b722d2e4d03aed80e1efead85a4', 'request_id': 'req-9c9a6595-459c-41ca-9d32-1cf67968c44b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:01.134108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe61b722d2e4d03aed80e1efead85a4', 'request_id': 'req-9c9a6595-459c-41ca-9d32-1cf67968c44b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:01.145081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] The token cache is being invalidate because project cbe61b722d2e4d03aed80e1efead85a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:01.145375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:01.146048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9c9a6595-459c-41ca-9d32-1cf67968c44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:01.147606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1065/2142] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:00 2022] DELETE /identity/v3/projects/cbe61b722d2e4d03aed80e1efead85a4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:01.152756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.153044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.153319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.173186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:01.174899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:01.217706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:01.234938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1078/2143] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:01.243186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.243466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.243801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.264123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:01.265311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:01.273260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1066/2144] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:01.280331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.290200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f970e-9b7d-4c1b-9c01-396465e99c97 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.294867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.295464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.295739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.296043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.296686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:01.296990 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.299226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.311906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1079/2145] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:01.320933 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.330804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd30a-2c89-4f18-8d59-e269cadd6ca5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.335402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.336017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.336293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.336558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.337185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.339061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.344457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:01.442579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1067/2146] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:01 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:01.446655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.461215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390381-ce37-4135-85ed-300cf5a80826 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.521137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.521747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.522030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.522417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.523051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.525067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.685690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1080/2147] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:01 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:01.690497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.701153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793ee4-6e66-42ca-b864-6fbc9b7ef8a2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.706378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.707025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.707303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.707572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.708252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.709838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.722920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1068/2148] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:01.726536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.738170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc956fe7-5b02-4872-a0ad-b02124f49248 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.744232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.744823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.745139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.745415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.746065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.766487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9265bc-0537-4990-af2a-3c255c206838 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.781294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1081/2149] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:01.785052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:01.795862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cdaa0-f874-43c1-b694-17655917129e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:01.801379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:01.802294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.802413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.802604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] PATH_INFO: `/v3/projects/724124169c174a8a9dd48452bb9764f0/users/9db1d0c88ce84dd897b61b5f5e29a4e9/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:01.817541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724124169c174a8a9dd48452bb9764f0, user_id=9db1d0c88ce84dd897b61b5f5e29a4e9, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:01.820596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:01.972822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1069/2150] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:01 2022] PUT /identity/v3/projects/724124169c174a8a9dd48452bb9764f0/users/9db1d0c88ce84dd897b61b5f5e29a4e9/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:01.983246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:01.983529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:01.983973 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.011696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] MFA Rules not processed for user `9db1d0c88ce84dd897b61b5f5e29a4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:02.012948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:02.087587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1082/2151] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:02.092611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.155534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752cb2-3807-4717-97eb-6f4f12a80b49 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.161296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.161925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.162205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.162604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.163389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.165428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.310099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1070/2152] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:02 2022] POST /identity/v3/projects => generated 409 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:02.315357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.326056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde1c9b-9677-4086-bc26-26e0ebf881d4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.382443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.383047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.383352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.383622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.384289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.386223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.537864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1083/2153] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:02 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:02.547552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.561009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e2b62-789a-4c2c-b93d-3f891ea11a59 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.566934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.567544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.567847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.568122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.568765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.570393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.582987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1071/2154] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:02.591501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.602803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88759c3-8ed4-4f6c-bf47-c179cb1c83bd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.608446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.609114 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.609398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.609673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] PATH_INFO: `/v3/projects/e46f72b4bd0f45e09628ad506abc7949/users/adeeecb842e74bbb8dea8ab0ed84c66c/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.629743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46f72b4bd0f45e09628ad506abc7949, user_id=adeeecb842e74bbb8dea8ab0ed84c66c, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.635001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.733668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:02.739867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1084/2155] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:02 2022] PUT /identity/v3/projects/e46f72b4bd0f45e09628ad506abc7949/users/adeeecb842e74bbb8dea8ab0ed84c66c/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:02.743706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.754750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8e0d-eab1-4487-9477-32e32f4c7802 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.815338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.815993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.816407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.816680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.817441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.819062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334289cd-ef4e-44ee-84b4-9df2a2a43eeb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.829831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1072/2156] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:02.833078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:02.836197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:02.848526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bdc-f164-444e-a379-31db98ce133a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:02.865790 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:02.866459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.866794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.867071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] PATH_INFO: `/v3/projects/e46f72b4bd0f45e09628ad506abc7949/users/adeeecb842e74bbb8dea8ab0ed84c66c/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.869045 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46f72b4bd0f45e09628ad506abc7949, user_id=adeeecb842e74bbb8dea8ab0ed84c66c, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:02.871663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:02.883041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1085/2157] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:02 2022] PUT /identity/v3/projects/e46f72b4bd0f45e09628ad506abc7949/users/adeeecb842e74bbb8dea8ab0ed84c66c/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:02.895164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318b960-e648-4599-9d97-baefe48d174c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:02.895451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318b960-e648-4599-9d97-baefe48d174c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:02.895733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318b960-e648-4599-9d97-baefe48d174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:02.925661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f318b960-e648-4599-9d97-baefe48d174c None None] MFA Rules not processed for user `adeeecb842e74bbb8dea8ab0ed84c66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:02.926907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f318b960-e648-4599-9d97-baefe48d174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:03.000043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1073/2158] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:02 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:03.011085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:03.012979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:03.072935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.196371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad9d6-fc11-481d-8686-5eee59827904 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:03.200089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:03.200686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:03.200959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:03.201227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:03.212534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:03.223807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:03.227205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1086/2159] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:03.588594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.656067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318b960-e648-4599-9d97-baefe48d174c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:03.657472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f318b960-e648-4599-9d97-baefe48d174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:03.670573 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318b960-e648-4599-9d97-baefe48d174c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:03.674759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:03.675355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:03.675663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:03.675968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:03.734910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:03.736583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634785ac-24dc-4f75-858a-1dfaf55e90d2 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:03.745694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1074/2160] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:03.773456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:03.960371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:03.961783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:04.025628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585efb3-5c9d-476d-97eb-99f4f5439c30 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:04.030112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:04.030728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:04.031001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:04.031270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] PATH_INFO: `/v3/users/7b1972ff6d0b4116b77e9411ff22f359` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:04.032399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1972ff6d0b4116b77e9411ff22f359)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:04.034553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:04.116446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:04.253503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1972ff6d0b4116b77e9411ff22f359'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:04.254155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1972ff6d0b4116b77e9411ff22f359'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:04.265619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1972ff6d0b4116b77e9411ff22f359'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:04.373343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1972ff6d0b4116b77e9411ff22f359'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:04.382566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1972ff6d0b4116b77e9411ff22f359'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:04.399423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1087/2161] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:03 2022] DELETE /identity/v3/users/7b1972ff6d0b4116b77e9411ff22f359 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:04.401550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:04.402158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:04.402158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:04.425596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:04.425596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:04.496123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1075/2162] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:04.503000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:04.504457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:04.565065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded520b9-e11e-42a7-af44-e5067352f0a1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:04.568766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:04.569369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:04.569639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:04.569903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:04.579022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:04.580776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:04.590113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1088/2163] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:04.737860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:04.846103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:05.029985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:05.031532 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:05.045368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01ce76-22ba-4442-95c4-201749d5f142 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:05.061419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:05.061676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:05.061752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:05.062006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] PATH_INFO: `/v3/projects/8b27e8e1130e41ada6ccc2c9c4081ed3` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:05.068013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b27e8e1130e41ada6ccc2c9c4081ed3)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:05.070082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:05.233988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b27e8e1130e41ada6ccc2c9c4081ed3', 'request_id': 'req-8e81507e-4118-451d-adf9-44ac0832d0ff'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.241203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b27e8e1130e41ada6ccc2c9c4081ed3', 'request_id': 'req-8e81507e-4118-451d-adf9-44ac0832d0ff'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.342613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b27e8e1130e41ada6ccc2c9c4081ed3', 'request_id': 'req-8e81507e-4118-451d-adf9-44ac0832d0ff'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.354859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] The token cache is being invalidate because project 8b27e8e1130e41ada6ccc2c9c4081ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:05.355145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.355801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.357329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1076/2164] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:05 2022] DELETE /identity/v3/projects/8b27e8e1130e41ada6ccc2c9c4081ed3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:05.361763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:05.372209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e10bc-6ac0-4fdb-86f5-1a1a80af0a8b service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:05.430982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:05.431597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:05.431943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:05.432208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] PATH_INFO: `/v3/users/eacebde57ae14933be6ba0b5730d70a5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:05.433306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacebde57ae14933be6ba0b5730d70a5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:05.435792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:05.724283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:05.738274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacebde57ae14933be6ba0b5730d70a5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.738921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacebde57ae14933be6ba0b5730d70a5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.750499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacebde57ae14933be6ba0b5730d70a5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.845182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacebde57ae14933be6ba0b5730d70a5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.852637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacebde57ae14933be6ba0b5730d70a5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:05.858505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1089/2165] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:05 2022] DELETE /identity/v3/users/eacebde57ae14933be6ba0b5730d70a5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:06.034448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:06.320038 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:06.320394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:06.345881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81507e-4118-451d-adf9-44ac0832d0ff admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:06.408057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:06.411725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:06.412391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:06.412671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:06.412945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] PATH_INFO: `/v3/projects/e08fcacdd4d44416a4d52d95f204ee7d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:06.414094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08fcacdd4d44416a4d52d95f204ee7d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:06.416031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:06.465979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:06.528411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08fcacdd4d44416a4d52d95f204ee7d', 'request_id': 'req-14e95594-a806-4f44-ad70-a214a8f740fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.535263 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08fcacdd4d44416a4d52d95f204ee7d', 'request_id': 'req-14e95594-a806-4f44-ad70-a214a8f740fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.673730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08fcacdd4d44416a4d52d95f204ee7d', 'request_id': 'req-14e95594-a806-4f44-ad70-a214a8f740fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.685246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] The token cache is being invalidate because project e08fcacdd4d44416a4d52d95f204ee7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:06.685564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.686193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.687668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1077/2166] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:06 2022] DELETE /identity/v3/projects/e08fcacdd4d44416a4d52d95f204ee7d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:06.692139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:06.693517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:06.708199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c213f-1db8-4f8b-b86e-f8d1f38873c3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:06.777176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:06.777838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:06.778078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:06.778350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] PATH_INFO: `/v3/users/0e35ea0e74364c9c8bffc3fc817188e9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:06.779465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e35ea0e74364c9c8bffc3fc817188e9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:06.781460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:06.976875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e35ea0e74364c9c8bffc3fc817188e9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.977775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e35ea0e74364c9c8bffc3fc817188e9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:06.997338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e35ea0e74364c9c8bffc3fc817188e9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.062456 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:07.090569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e35ea0e74364c9c8bffc3fc817188e9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.099597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85d1f740-9455-426e-8689-8b5b6fd7ab43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e35ea0e74364c9c8bffc3fc817188e9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.105020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1090/2167] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:06 2022] DELETE /identity/v3/users/0e35ea0e74364c9c8bffc3fc817188e9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:07.177010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:07.428618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:07.561418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:07.562985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:07.578329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e95594-a806-4f44-ad70-a214a8f740fc admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:07.638664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:07.639300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:07.639574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:07.639897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] PATH_INFO: `/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:07.641008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33e9ba5eda444ee861c3b5b6a53ebe1)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:07.643555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:07.764970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33e9ba5eda444ee861c3b5b6a53ebe1', 'request_id': 'req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.784748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33e9ba5eda444ee861c3b5b6a53ebe1', 'request_id': 'req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.875997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33e9ba5eda444ee861c3b5b6a53ebe1', 'request_id': 'req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.888105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] The token cache is being invalidate because project e33e9ba5eda444ee861c3b5b6a53ebe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:07.888331 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.888964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4d460fae-836d-4c4f-b0c7-243ac84c8b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:07.890457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1078/2168] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:07 2022] DELETE /identity/v3/projects/e33e9ba5eda444ee861c3b5b6a53ebe1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:07.895406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:07.895978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:07.895978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:07.915140 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:07.916387 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:07.943361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:07.983058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1091/2169] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:07.991084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:07.991367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:07.991640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.012627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:08.015542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:08.022364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1079/2170] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:08.035261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.036168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:08.041462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40404e4f-1244-4a82-87c5-c75c2e0889e8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.046311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.046918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.047191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.047482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.048187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:08.048524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.050889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.062517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1092/2171] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:08.067608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.076931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd117f7-53f2-4bc6-8432-72c503ae005a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.082234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.082839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.083116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.083371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.084031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.085946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.226349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1080/2172] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:08 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:08.230536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.241058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045cb69-bcb5-4b26-b980-0ab3a99db2ed admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.296952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.297552 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.297830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.298105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.298718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.301363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.373130 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:08.393749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1093/2173] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:08 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:08.396775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.407398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af875-ac00-4a9a-80b8-b3944084cae0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.413056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.413660 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.413944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.414218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.414872 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.416537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.428090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1081/2174] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:08.431951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.441921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c1b2-971e-448d-86ff-798ed9454043 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.446567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.451254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.451254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.451254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.451254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.451254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b39ec-afc8-44ae-86f5-9f5cda4e60ed admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.460656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1094/2175] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:08.464753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.475125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9110801-5323-4edb-87c0-f134121991ad admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.479698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.480391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.480687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.480943 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] PATH_INFO: `/v3/projects/1c68827d26d849e0828ad3377fcf05ab/users/fb1acd3b80e74fbe8182c437a511b5a1/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.495909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c68827d26d849e0828ad3377fcf05ab, user_id=fb1acd3b80e74fbe8182c437a511b5a1, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.498551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.614579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1082/2176] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:08 2022] PUT /identity/v3/projects/1c68827d26d849e0828ad3377fcf05ab/users/fb1acd3b80e74fbe8182c437a511b5a1/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:08.626113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.626406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.626678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.655243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] MFA Rules not processed for user `fb1acd3b80e74fbe8182c437a511b5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:08.656510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:08.722183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1095/2177] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:08.733336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:08.735028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:08.757027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:08.795327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e393a-f491-4ddf-bc20-0a2f52704f1d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:08.799457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:08.800147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:08.800556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:08.800905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:08.810486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:08.812261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212e61-7fe2-4cfd-a864-6ddfa9de9f4d service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:08.822069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1083/2178] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:09.282128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:09.478830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:09.480466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:09.545705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:09.559468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39280e00-3894-4e4a-9fdd-1244b135f12e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:09.568728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:09.568728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:09.568728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:09.568728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] PATH_INFO: `/v3/users/5321392b483844b6ada66a436712e948` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:09.569056 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5321392b483844b6ada66a436712e948)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:09.570184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:09.807704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5321392b483844b6ada66a436712e948'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:09.808445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5321392b483844b6ada66a436712e948'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:09.820290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5321392b483844b6ada66a436712e948'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:09.930474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5321392b483844b6ada66a436712e948'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:09.937615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5321392b483844b6ada66a436712e948'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:09.943474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1096/2179] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:09 2022] DELETE /identity/v3/users/5321392b483844b6ada66a436712e948 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:09.947955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:09.948245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:09.948523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:09.967989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:09.969253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:10.044224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1084/2180] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:10.058119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:10.059576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:10.125678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c0f2-e963-40ed-8da2-03d6c25cfcac admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:10.129425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:10.130035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:10.130304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:10.130567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:10.147360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:10.149094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:10.163294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:10.168703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1097/2181] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:10.459474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:10.747656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:10.749293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:10.762858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bfaac-8a39-45b7-9a36-8695aa1d29e1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:10.768398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:10.769071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:10.769350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:10.769623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] PATH_INFO: `/v3/projects/f4f9fc1a41bf466aaf41d80bc6e8462e` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:10.781258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f9fc1a41bf466aaf41d80bc6e8462e)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:10.781258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:10.894492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f9fc1a41bf466aaf41d80bc6e8462e', 'request_id': 'req-319f9aae-165b-4146-a9cf-c0c32bc1a040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:10.901215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f9fc1a41bf466aaf41d80bc6e8462e', 'request_id': 'req-319f9aae-165b-4146-a9cf-c0c32bc1a040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:10.990980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:10.992451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f9fc1a41bf466aaf41d80bc6e8462e', 'request_id': 'req-319f9aae-165b-4146-a9cf-c0c32bc1a040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.003558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] The token cache is being invalidate because project f4f9fc1a41bf466aaf41d80bc6e8462e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:11.003876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.004517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.006051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1085/2182] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:10 2022] DELETE /identity/v3/projects/f4f9fc1a41bf466aaf41d80bc6e8462e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:11.010150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:11.021187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc28a3-ac73-4970-a519-8f891e3b2a89 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:11.081210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:11.081908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:11.082265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:11.082547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] PATH_INFO: `/v3/users/87f29c3925ed49d8998dd37819077c55` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:11.083748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f29c3925ed49d8998dd37819077c55)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:11.085957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:11.095590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:11.098585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:11.112148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f9aae-165b-4146-a9cf-c0c32bc1a040 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:11.122614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:11.123260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:11.123539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:11.123834 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] PATH_INFO: `/v3/users/9db1d0c88ce84dd897b61b5f5e29a4e9` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:11.125003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db1d0c88ce84dd897b61b5f5e29a4e9)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:11.127215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:11.229360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:11.296197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f29c3925ed49d8998dd37819077c55'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.297037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f29c3925ed49d8998dd37819077c55'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.312897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f29c3925ed49d8998dd37819077c55'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.326583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db1d0c88ce84dd897b61b5f5e29a4e9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.327327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db1d0c88ce84dd897b61b5f5e29a4e9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.335748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db1d0c88ce84dd897b61b5f5e29a4e9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.392811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f29c3925ed49d8998dd37819077c55'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.401462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-208b447f-fd09-4e04-9240-33bdaabf47f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f29c3925ed49d8998dd37819077c55'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.407441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1098/2183] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:11 2022] DELETE /identity/v3/users/87f29c3925ed49d8998dd37819077c55 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:11.452881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db1d0c88ce84dd897b61b5f5e29a4e9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.469390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db1d0c88ce84dd897b61b5f5e29a4e9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:11.476208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1086/2184] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:11 2022] DELETE /identity/v3/users/9db1d0c88ce84dd897b61b5f5e29a4e9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:11.480937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:11.481353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:11.481852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:11.505568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:11.506905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:11.568761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1099/2185] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:11.578541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:11.579952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:11.643055 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e5c-3eaf-4c9e-bc27-1335b912b3dd admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:11.646650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:11.647336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:11.647515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:11.647794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:11.657912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:11.660034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024929d-96b6-4327-80f3-02317fc8583c service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:11.670448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1087/2186] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:11.832928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:11.834444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:11.867395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025976d7-2032-4ff3-8765-e151d3f75bce None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:11.867395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:11.867395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:11.867395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:11.867905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] PATH_INFO: `/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:11.867905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0588ed896ac444d0bedd15fc07ffc8ac)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:11.867905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:11.968554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:11.996717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0588ed896ac444d0bedd15fc07ffc8ac', 'request_id': 'req-88d04b3a-38b4-4844-90c4-3db5d70d75e1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.056829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:12.093000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0588ed896ac444d0bedd15fc07ffc8ac', 'request_id': 'req-88d04b3a-38b4-4844-90c4-3db5d70d75e1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.100920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0588ed896ac444d0bedd15fc07ffc8ac', 'request_id': 'req-88d04b3a-38b4-4844-90c4-3db5d70d75e1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.121521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] The token cache is being invalidate because project 0588ed896ac444d0bedd15fc07ffc8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:12.121832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.122493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.124113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1100/2187] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:11 2022] DELETE /identity/v3/projects/0588ed896ac444d0bedd15fc07ffc8ac => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:12.129030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3ba8-67c0-4030-ab1a-31a86d49b72f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.129312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3ba8-67c0-4030-ab1a-31a86d49b72f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.129582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3ba8-67c0-4030-ab1a-31a86d49b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.150227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9d0d3ba8-67c0-4030-ab1a-31a86d49b72f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:12.151441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9d0d3ba8-67c0-4030-ab1a-31a86d49b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.193489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.197276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.248312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1088/2188] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:12.263659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.264303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.264581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.288307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:12.291669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.308374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04b3a-38b4-4844-90c4-3db5d70d75e1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.308548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1089/2189] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:12.309462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.316025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.317162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.317574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.317984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] PATH_INFO: `/v3/projects/724124169c174a8a9dd48452bb9764f0` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.319297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=724124169c174a8a9dd48452bb9764f0)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.319714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4138f5-f34c-4816-a75f-eefc230e3047 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.321208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.324523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.325125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.325401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.325668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.326316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:12.326616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.328229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.341706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1090/2190] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:12.346149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.356431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6ac2-5a14-41f2-863d-6e4f675c342f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.362227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.362986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.363082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.363420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.363970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.365966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.434971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724124169c174a8a9dd48452bb9764f0', 'request_id': 'req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.458889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1091/2191] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:12.462915 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.526571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcec6-1c44-430c-9585-75242d95b169 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.531720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.532359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.532640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.532911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.533751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.535775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.539608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724124169c174a8a9dd48452bb9764f0', 'request_id': 'req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.551156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724124169c174a8a9dd48452bb9764f0', 'request_id': 'req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.562786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] The token cache is being invalidate because project 724124169c174a8a9dd48452bb9764f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:12.563180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.564475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.566761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1101/2192] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:12 2022] DELETE /identity/v3/projects/724124169c174a8a9dd48452bb9764f0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:12.570784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.572343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.643201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ae98-42f0-4983-b9d5-eca584c9c7bc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.649091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.649765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.650084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.650360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] PATH_INFO: `/v3/users/adeeecb842e74bbb8dea8ab0ed84c66c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.652709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adeeecb842e74bbb8dea8ab0ed84c66c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.660437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.664432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1092/2193] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:12 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:12.669928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.671815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.687645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121cb9-a105-45c0-90bf-bea91d48ea78 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.694254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.694944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.695315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.695679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.696505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.698090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.709129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1093/2194] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:12.713267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.724436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe325e1-4dea-46a6-b11c-774735ffca0a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.729188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.729811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.730115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.730385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.731072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.732686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.744242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1094/2195] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:12.748913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:12.762166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec46aed-eb71-4638-998e-4bae4b5681ec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:12.769825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:12.770702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.771131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.771693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] PATH_INFO: `/v3/projects/3bbd4d693e0e458a9806cfedf4195bc0/users/b5f02330fb5c400eabcc4bcdbe51fbad/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.794050 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbd4d693e0e458a9806cfedf4195bc0, user_id=b5f02330fb5c400eabcc4bcdbe51fbad, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:12.796719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e87758-89e5-4147-9ff4-4f444a63f074 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:12.851357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adeeecb842e74bbb8dea8ab0ed84c66c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.852131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adeeecb842e74bbb8dea8ab0ed84c66c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.865184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adeeecb842e74bbb8dea8ab0ed84c66c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.910525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1095/2196] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:12 2022] PUT /identity/v3/projects/3bbd4d693e0e458a9806cfedf4195bc0/users/b5f02330fb5c400eabcc4bcdbe51fbad/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:12.921318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:12.921866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:12.922191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:12.970597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adeeecb842e74bbb8dea8ab0ed84c66c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:12.971883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] MFA Rules not processed for user `b5f02330fb5c400eabcc4bcdbe51fbad`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:12.973626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:12.981517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adeeecb842e74bbb8dea8ab0ed84c66c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:13.013263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1102/2197] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:12 2022] DELETE /identity/v3/users/adeeecb842e74bbb8dea8ab0ed84c66c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:13.025143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:13.066753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1096/2198] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:13.071451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.086587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:13.187253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481032c3-654f-4f72-9b44-45c66872c86a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:13.192892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:13.197081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:13.197081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:13.197081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:13.197081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:13.197081 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:13.339303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1103/2199] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:13 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:13.343584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.481725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f026-5b77-4f8a-b66f-79478e611faa None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:13.535420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:13.582112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:13.582727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:13.583000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:13.583265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:13.583922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:13.586135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:13.657414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.659810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:13.675892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2ea2-f5db-4e61-9712-7d21180982f9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:13.687476 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1097/2200] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:13 2022] POST /identity/v3/users => generated 300 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:13.689268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.693340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:13.694198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:13.694639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:13.694946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] PATH_INFO: `/v3/projects/e46f72b4bd0f45e09628ad506abc7949` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:13.696357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46f72b4bd0f45e09628ad506abc7949)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:13.698328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:13.701415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4324-4211-457c-8d66-dcfe9f7029bc admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:13.702420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:13.707850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:13.708456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:13.708739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:13.708994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:13.709650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:13.711306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:13.723219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1098/2201] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:13.727176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.737264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b29f2-ab4b-4300-b16b-2e6dc32204bd admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:13.742219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:13.742866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:13.743149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:13.743423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] PATH_INFO: `/v3/projects/7408db28030c4f2c826144b91d130303/users/bffd96ade44b4f0dbaa6630077453538/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:13.760684 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7408db28030c4f2c826144b91d130303, user_id=bffd96ade44b4f0dbaa6630077453538, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:13.763681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:13.918269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1099/2202] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:13 2022] PUT /identity/v3/projects/7408db28030c4f2c826144b91d130303/users/bffd96ade44b4f0dbaa6630077453538/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:13.919588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:13.923975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46f72b4bd0f45e09628ad506abc7949', 'request_id': 'req-211323a9-73a5-4161-9141-7df8c214582c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:13.994751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9c6eb-afbf-4fb6-97ab-220d9d7d0284 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.062986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.063594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.064027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.064303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.064950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.067447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.068783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46f72b4bd0f45e09628ad506abc7949', 'request_id': 'req-211323a9-73a5-4161-9141-7df8c214582c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.079324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46f72b4bd0f45e09628ad506abc7949', 'request_id': 'req-211323a9-73a5-4161-9141-7df8c214582c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.091835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1100/2203] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:14.094892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.095378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] The token cache is being invalidate because project e46f72b4bd0f45e09628ad506abc7949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:14.095679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.096556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-211323a9-73a5-4161-9141-7df8c214582c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.102423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1104/2204] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:13 2022] DELETE /identity/v3/projects/e46f72b4bd0f45e09628ad506abc7949 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:14.111370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089a499-376d-4e0a-95ba-75b25cf5163d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.113652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc3b8-3fad-4528-8c16-576a97aa826a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.113935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc3b8-3fad-4528-8c16-576a97aa826a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.114682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc3b8-3fad-4528-8c16-576a97aa826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.117630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.118311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.118645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.119010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] PATH_INFO: `/v3/projects/7408db28030c4f2c826144b91d130303/users/bffd96ade44b4f0dbaa6630077453538/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.121155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7408db28030c4f2c826144b91d130303, user_id=bffd96ade44b4f0dbaa6630077453538, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.123913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcefdb8-bdd1-4df9-a475-44086569c894 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.137277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1101/2205] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:14 2022] PUT /identity/v3/projects/7408db28030c4f2c826144b91d130303/users/bffd96ade44b4f0dbaa6630077453538/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:14.140995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-202bc3b8-3fad-4528-8c16-576a97aa826a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:14.145381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-202bc3b8-3fad-4528-8c16-576a97aa826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.148064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.148431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.149041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.194191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] MFA Rules not processed for user `bffd96ade44b4f0dbaa6630077453538`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:14.195637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.233715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1105/2206] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:14.242483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.242842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.243233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.264923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:14.266132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.273537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1102/2207] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:14.274506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1106/2208] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:14.278866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.285917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.287333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.290670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e472e2-b548-4e48-b713-cbe219d060e0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.295413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.296068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.296349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.296622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.297449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:14.297758 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.299884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.312984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1103/2209] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:14.317816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.329215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286bbc-83e0-427e-a63f-64c0025c5c08 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.340934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.341785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.346059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.346059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.346059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.346059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.353769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b3fc-4141-401c-894b-650e1145e8fc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.357578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.358180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.358522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.358794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.371082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.372707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.383034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1107/2210] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:14.452158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.453557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.460176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1104/2211] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:14.466385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.470477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70946028-1ee3-4c78-bc00-63774b8efbcb service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.539163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.539938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.540470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.540819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] PATH_INFO: `/v3/users/b5f02330fb5c400eabcc4bcdbe51fbad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.542065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f02330fb5c400eabcc4bcdbe51fbad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.544133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.549698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6bfc-359d-4371-8932-5f3086236e17 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.558052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.558761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.559030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.559252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.559959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.561998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.670754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1105/2212] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:14.675399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.686286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf0b1-7bf5-4c80-96a6-66e0b82108f5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.691571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.692389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.692612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.692867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.693504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.695144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.705477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1106/2213] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:14.713656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.725058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226147-12a0-4cf7-8c04-6a04e43e4a35 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.729947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.730546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.730837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.731109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.731775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.739557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.745058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f02330fb5c400eabcc4bcdbe51fbad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.745232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1107/2214] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:14.745744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f02330fb5c400eabcc4bcdbe51fbad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.749486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:14.751184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.759145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f02330fb5c400eabcc4bcdbe51fbad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.765539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b893ac-9f04-499a-8ef6-fde20b0a86ea admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:14.771009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:14.771667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.771979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.772252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] PATH_INFO: `/v3/projects/ee547e9e2edc47e597cd2b120b35e222/users/9e462ad46cd74ba8a08b931949292e42/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.790485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee547e9e2edc47e597cd2b120b35e222, user_id=9e462ad46cd74ba8a08b931949292e42, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:14.793254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59665-027d-4e15-a4f0-999c224d9553 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:14.853078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:14.887775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f02330fb5c400eabcc4bcdbe51fbad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.895745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1108/2215] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:14 2022] PUT /identity/v3/projects/ee547e9e2edc47e597cd2b120b35e222/users/9e462ad46cd74ba8a08b931949292e42/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:14.899231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-269277e1-2f9d-415a-bde2-d96193b43b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f02330fb5c400eabcc4bcdbe51fbad'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:14.907347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.907628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.907936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.920659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1108/2216] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:14 2022] DELETE /identity/v3/users/b5f02330fb5c400eabcc4bcdbe51fbad => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:14.923490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:14.924001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:14.926305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:14.944131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] MFA Rules not processed for user `9e462ad46cd74ba8a08b931949292e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:14.945936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:14.947265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:14.949905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:14.950939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:15.029371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1109/2217] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:15.036702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1109/2218] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:15.045435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.045551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.047147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:15.054570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:15.058830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd57482-6fa7-4cce-b7a0-e787e176fd26 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.066777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.067809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.067809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.068166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.068986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.073309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.118467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c9def-5d12-4b66-8187-7d16cd971abd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.122476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.122849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.123126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.123466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.134125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.135986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.148008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1110/2219] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:15.188673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.189648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1110/2220] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:15 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:15.212849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff3d5c-b7e8-49aa-9527-a193aab9d35e service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.314573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.315764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.317174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.317641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.318470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.320711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.488635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1111/2221] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:15 2022] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:15.488736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.494545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb6b0-85b6-4a15-9428-30e3f18330a1 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.498621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.499875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.501732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.502239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.507035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:15.507515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.507515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.523339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1111/2222] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:15.534316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.544302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53d03-2019-4acf-8e06-eb87baa6eb85 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.549115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.549774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.550055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.550331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] PATH_INFO: `/v3/projects/75dff0e4c7e445b792c315b0033d21ca/users/7e3553cd809a49e0ba3272c79fb7729b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.570429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dff0e4c7e445b792c315b0033d21ca, user_id=7e3553cd809a49e0ba3272c79fb7729b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.575863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.702541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:15.712293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1112/2223] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:15 2022] PUT /identity/v3/projects/75dff0e4c7e445b792c315b0033d21ca/users/7e3553cd809a49e0ba3272c79fb7729b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:15.716185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.727425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d6ee-473f-440e-a13a-8abd11d7c561 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.787760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.788417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.788693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.788957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.800605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.800605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.802421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1112/2224] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:15.806774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.819326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b217d-5091-4585-bb8d-218221460e27 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.824921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.825723 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.826040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.826370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] PATH_INFO: `/v3/projects/75dff0e4c7e445b792c315b0033d21ca/users/7e3553cd809a49e0ba3272c79fb7729b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.828469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dff0e4c7e445b792c315b0033d21ca, user_id=7e3553cd809a49e0ba3272c79fb7729b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.831442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aac96-872a-48d4-81ce-ff48716d63b8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.842726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1113/2225] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:15 2022] PUT /identity/v3/projects/75dff0e4c7e445b792c315b0033d21ca/users/7e3553cd809a49e0ba3272c79fb7729b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:15.853963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.856151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:15.943565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.943565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.943565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.944811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6d24-ee90-4fa1-ba80-2e10ce6c07b1 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:15.945195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] MFA Rules not processed for user `7e3553cd809a49e0ba3272c79fb7729b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:15.945195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:15.945729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:15.945729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:15.945729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:15.945729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] PATH_INFO: `/v3/projects/3bbd4d693e0e458a9806cfedf4195bc0` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:15.946125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbd4d693e0e458a9806cfedf4195bc0)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:15.948376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:15.988698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1114/2226] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:15.995180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:15.996646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:16.074886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e0d9-f425-4fd3-bfdb-f7b3b68f388e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:16.079345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:16.080513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:16.080880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:16.081222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:16.094741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:16.096736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:16.110514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1115/2227] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:16.173832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbd4d693e0e458a9806cfedf4195bc0', 'request_id': 'req-b074ee82-0848-4962-8d5a-7856ec2d8d3a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.181280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbd4d693e0e458a9806cfedf4195bc0', 'request_id': 'req-b074ee82-0848-4962-8d5a-7856ec2d8d3a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.302277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbd4d693e0e458a9806cfedf4195bc0', 'request_id': 'req-b074ee82-0848-4962-8d5a-7856ec2d8d3a'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.321718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] The token cache is being invalidate because project 3bbd4d693e0e458a9806cfedf4195bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:16.322081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.322791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.324661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1113/2228] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:15 2022] DELETE /identity/v3/projects/3bbd4d693e0e458a9806cfedf4195bc0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:16.328263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:16.340047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d084af-5629-4ab9-8c92-a9d8e87e36d4 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:16.399113 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:16.399744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:16.400053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:16.400322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] PATH_INFO: `/v3/users/bffd96ade44b4f0dbaa6630077453538` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:16.401447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffd96ade44b4f0dbaa6630077453538)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:16.405065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:16.537141 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:16.679833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffd96ade44b4f0dbaa6630077453538'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.680871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffd96ade44b4f0dbaa6630077453538'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.698753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffd96ade44b4f0dbaa6630077453538'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.800239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffd96ade44b4f0dbaa6630077453538'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.808976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffd96ade44b4f0dbaa6630077453538'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:16.816939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1116/2229] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:16 2022] DELETE /identity/v3/users/bffd96ade44b4f0dbaa6630077453538 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:17.205465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:17.482982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:17.484489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:17.504360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee82-0848-4962-8d5a-7856ec2d8d3a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:17.582746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:17.583983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:17.588255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:17.588255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] PATH_INFO: `/v3/projects/7408db28030c4f2c826144b91d130303` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:17.588255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7408db28030c4f2c826144b91d130303)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:17.590450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:17.668955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:17.804408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7408db28030c4f2c826144b91d130303', 'request_id': 'req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:17.821120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:17.833430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:17.844488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7408db28030c4f2c826144b91d130303', 'request_id': 'req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:17.854583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7086-cb3d-441f-8fa8-54e9dc5dac31 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:17.928760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:17.930379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:17.930895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:17.931385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] PATH_INFO: `/v3/users/9e462ad46cd74ba8a08b931949292e42` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:17.934345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e462ad46cd74ba8a08b931949292e42)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:17.937494 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:17.949881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7408db28030c4f2c826144b91d130303', 'request_id': 'req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:17.963453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] The token cache is being invalidate because project 7408db28030c4f2c826144b91d130303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:17.963741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:17.964908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e94c6bcf-395d-4da0-bbec-a83e9bd7696c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:17.979880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1114/2230] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:17 2022] DELETE /identity/v3/projects/7408db28030c4f2c826144b91d130303 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:17.983447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fadd-e3c9-4fd6-945b-90899ac0e30c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:17.983734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fadd-e3c9-4fd6-945b-90899ac0e30c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:17.984026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fadd-e3c9-4fd6-945b-90899ac0e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.008650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c385fadd-e3c9-4fd6-945b-90899ac0e30c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:18.009715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c385fadd-e3c9-4fd6-945b-90899ac0e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.032488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1115/2231] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:18.040206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.041838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.041838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.071485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:18.073183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.082919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1116/2232] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:18.087346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.102504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dba85-8400-4ff2-8728-d8db6c59a942 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.108622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.109274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.109631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.109976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.110813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:18.111200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.112947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.125232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1117/2233] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:42:18.133588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.142603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ed8c-2caa-4275-b3e4-781b76f36fc8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.149988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.150630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.150903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.151171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.151808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.153729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.191588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e462ad46cd74ba8a08b931949292e42'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:18.192705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e462ad46cd74ba8a08b931949292e42'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:18.208312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e462ad46cd74ba8a08b931949292e42'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:18.246268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1118/2234] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:18.248443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.250312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.265324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e462ad46cd74ba8a08b931949292e42'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:18.275464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-68e0134b-ef4d-49f6-be4c-9d55e7652c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e462ad46cd74ba8a08b931949292e42'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:18.283332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1117/2235] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:17 2022] DELETE /identity/v3/users/9e462ad46cd74ba8a08b931949292e42 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:18.287960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.288257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.288531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.316124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:18.318517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.332928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84ebf-3da1-4091-8d61-2c59d332f23a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.345930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:18.396011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1118/2236] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:18.402775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.404480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.410257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.410909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.411168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.411589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.412388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.414384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.469536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011114-e172-46b4-a5f7-3c5bacc1bca1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.473255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.473884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.474247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.474520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.484406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.486043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.496548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1119/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:18.541086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1119/2238] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:18.546408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.557801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990d23-bf14-4136-8634-557a57c56c51 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.562927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.567040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.567040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.567040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.567040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.567040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.577819 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1120/2239] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:18.582935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.595747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1d957-4b35-49ef-b16a-c8e4b2930d1d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.601447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.602059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.602335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.602603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.603251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.604891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5b05d-5406-4c5d-8320-b7c619eada3d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.629455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1120/2240] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:18.629685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:18.633492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142778-fa46-4b17-adbd-45773834a0d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:18.638412 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:18.639073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.639355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.639762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] PATH_INFO: `/v3/projects/51a533e0061f4261ba28e3ae23a77f8e/users/0a1832089b7e46feafee13a353ecc914/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.657875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a533e0061f4261ba28e3ae23a77f8e, user_id=0a1832089b7e46feafee13a353ecc914, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:18.661377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:18.772157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1121/2241] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:18 2022] PUT /identity/v3/projects/51a533e0061f4261ba28e3ae23a77f8e/users/0a1832089b7e46feafee13a353ecc914/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:18.782255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:18.783756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:18.784167 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:18.818370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] MFA Rules not processed for user `0a1832089b7e46feafee13a353ecc914`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:18.819929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:18.869679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:18.906505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1121/2242] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:18.908150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.000386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d624-e0f5-40cd-9409-4766ecd20222 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.005543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.006167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.006445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.006715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.007343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.009322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.111117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1122/2243] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:18 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:19.115505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.130203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd72b8-6a69-4f3a-8d9f-2ad5d88cc6c0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.198162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.199244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.199549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.199861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.200510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.205488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.255014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.256558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:19.286944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad2dd-81d3-497e-afdd-63ba1f8565b9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.292386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.293109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.293464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.293808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] PATH_INFO: `/v3/projects/ee547e9e2edc47e597cd2b120b35e222` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.300381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee547e9e2edc47e597cd2b120b35e222)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.303812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.356605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1122/2244] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:19 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:19.361597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.373904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7f6c-5b35-4f79-a329-97b475624432 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.379613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.380914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.381604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.381909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.382580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.386995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.398370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1123/2245] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:19.402493 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.420457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4279e6-34b5-4fec-b064-902a53f9588f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.426182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee547e9e2edc47e597cd2b120b35e222', 'request_id': 'req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.431877 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:19.486194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.486716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.486916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.487379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] PATH_INFO: `/v3/projects/ed160d0041884962aeb17c36c422ddbb/users/f06ff9ee50c3466484182eda8404a484/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.505145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed160d0041884962aeb17c36c422ddbb, user_id=f06ff9ee50c3466484182eda8404a484, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.508327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.520838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee547e9e2edc47e597cd2b120b35e222', 'request_id': 'req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.529374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee547e9e2edc47e597cd2b120b35e222', 'request_id': 'req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.540525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] The token cache is being invalidate because project ee547e9e2edc47e597cd2b120b35e222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:19.540814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.541488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.543016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1123/2246] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:19 2022] DELETE /identity/v3/projects/ee547e9e2edc47e597cd2b120b35e222 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:19.546980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.548372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:19.562063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf8ff8-2f96-4897-bfb2-0462e2b0432f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.567327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.568042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.568322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.568593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] PATH_INFO: `/v3/users/7e3553cd809a49e0ba3272c79fb7729b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.569734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3553cd809a49e0ba3272c79fb7729b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.571639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.657010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1124/2247] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:19 2022] PUT /identity/v3/projects/ed160d0041884962aeb17c36c422ddbb/users/f06ff9ee50c3466484182eda8404a484/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:19.662027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.663690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:19.752311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164665f-2c1c-46e4-824b-bbea36c6269a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.758302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.765354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.765354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.765354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.765354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.765354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.773094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1125/2248] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:19.777337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.788265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11882d8-a601-42b5-a82f-cb9d56ddf104 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:19.805750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:19.805750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.805750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.805750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] PATH_INFO: `/v3/projects/ed160d0041884962aeb17c36c422ddbb/users/f06ff9ee50c3466484182eda8404a484/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.806147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed160d0041884962aeb17c36c422ddbb, user_id=f06ff9ee50c3466484182eda8404a484, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:19.806225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3553cd809a49e0ba3272c79fb7729b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.806649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc04d53-014a-4e9e-aeeb-819a166e9661 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:19.806725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3553cd809a49e0ba3272c79fb7729b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.810123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1126/2249] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:19 2022] PUT /identity/v3/projects/ed160d0041884962aeb17c36c422ddbb/users/f06ff9ee50c3466484182eda8404a484/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:19.820329 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3553cd809a49e0ba3272c79fb7729b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.822068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295a2c-b58f-40af-afde-7e782a97f5a8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:19.822356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295a2c-b58f-40af-afde-7e782a97f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:19.822633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295a2c-b58f-40af-afde-7e782a97f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:19.853747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fd295a2c-b58f-40af-afde-7e782a97f5a8 None None] MFA Rules not processed for user `f06ff9ee50c3466484182eda8404a484`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:19.855200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fd295a2c-b58f-40af-afde-7e782a97f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:19.896999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3553cd809a49e0ba3272c79fb7729b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.907021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3553cd809a49e0ba3272c79fb7729b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:19.915247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1124/2250] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:19 2022] DELETE /identity/v3/users/7e3553cd809a49e0ba3272c79fb7729b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:19.921851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:19.942904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1127/2251] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:19.954786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:19.957130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:20.031210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aaf77-b528-4711-9979-2cd5ac9ee014 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:20.037000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:20.037728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:20.038012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:20.038327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:20.040409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:20.108903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:20.110326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:20.120659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1125/2252] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:20.229864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.412516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3ef5-48f4-439a-9486-5667bf2a43ac None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:20.414791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3ef5-48f4-439a-9486-5667bf2a43ac None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:20.415297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3ef5-48f4-439a-9486-5667bf2a43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:20.437223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-297d3ef5-48f4-439a-9486-5667bf2a43ac None None] MFA Rules not processed for user `7e35335d035c44daaf79627c255e9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:20.438508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-297d3ef5-48f4-439a-9486-5667bf2a43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:20.502119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:20.502985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1128/2253] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:20.509892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:20.607979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1912-c575-4f52-94dd-fd9cb89545cf service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:20.616365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:20.616365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:20.616365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:20.616365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] PATH_INFO: `/v3/projects/75dff0e4c7e445b792c315b0033d21ca` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:20.624088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dff0e4c7e445b792c315b0033d21ca)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:20.624088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:20.752674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dff0e4c7e445b792c315b0033d21ca', 'request_id': 'req-69a340ef-5b5d-4ab1-9308-6fefe5513784'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:20.833807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dff0e4c7e445b792c315b0033d21ca', 'request_id': 'req-69a340ef-5b5d-4ab1-9308-6fefe5513784'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:20.840960 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dff0e4c7e445b792c315b0033d21ca', 'request_id': 'req-69a340ef-5b5d-4ab1-9308-6fefe5513784'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:20.851916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] The token cache is being invalidate because project 75dff0e4c7e445b792c315b0033d21ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:20.852208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:20.852882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-69a340ef-5b5d-4ab1-9308-6fefe5513784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:20.854392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1126/2254] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:20 2022] DELETE /identity/v3/projects/75dff0e4c7e445b792c315b0033d21ca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:20.859626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:20.859952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:20.860228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:20.883707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:20.884984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:20.953599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1129/2255] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:20.961565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.965665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:20.966279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:20.966764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:20.997957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:20.999918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:21.001327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:21.010537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1127/2256] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:21.016591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.029615 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5e1b3-cba6-4cb8-a45f-2c154da57275 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.036275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.037311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.037791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.038137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.038906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:21.039283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.041606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.091126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1130/2257] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:21.094961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.110902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16fcf4-b957-41a7-9584-185bb55cb315 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.118441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.119399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.119680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.119989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.120636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.123464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.261317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1128/2258] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:21 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:21.265328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.275630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef46c-8c0b-4bc6-93d9-38839a21eaf8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.349075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.349713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.349989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.350257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.350919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.352936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.454290 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1131/2259] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:21 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:21.458018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.478962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0978-052c-4c16-ae6d-0b241f883374 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.485457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.485457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.485457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.485457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.485940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.487538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.505755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1129/2260] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:21.507206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.526099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d040-83ce-4824-880a-7c3258ce0e7f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.539618 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.540273 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.540548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.540816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.541460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.543313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc58a6-5cb2-4eaf-b3f2-19deb080ed50 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.558564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1132/2261] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:21.560874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.582389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c984a5-8f4d-4b58-8487-04810386e15c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.596043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.596043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.596043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.596463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] PATH_INFO: `/v3/projects/4a142857cc9d4c1fbd5d3eccc3984de4/users/8eedd053590a4d71b69f1a8f45612c1b/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.625810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a142857cc9d4c1fbd5d3eccc3984de4, user_id=8eedd053590a4d71b69f1a8f45612c1b, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.628864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.774089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1130/2262] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:21 2022] PUT /identity/v3/projects/4a142857cc9d4c1fbd5d3eccc3984de4/users/8eedd053590a4d71b69f1a8f45612c1b/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:21.779468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.779757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.780074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.801742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:21.803140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:21.869634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1133/2263] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:21.880744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:21.882014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:21.942816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3257-c23c-45c5-88c1-e84021e2df8f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:21.946531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:21.947133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:21.947406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:21.947668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:21.958720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:21.960266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4599c-7df0-4197-9e9d-8a4c0d2f264b service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:21.970731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1131/2264] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:22.098655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:22.100266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:22.116645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac22d31-7d1a-46f8-ba62-d016547c99c8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:22.124463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:22.125114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:22.125391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:22.126173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] PATH_INFO: `/v3/users/fb1acd3b80e74fbe8182c437a511b5a1` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:22.127842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1acd3b80e74fbe8182c437a511b5a1)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:22.131177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:22.150790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:22.235610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:22.340663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1acd3b80e74fbe8182c437a511b5a1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:22.341324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1acd3b80e74fbe8182c437a511b5a1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:22.348895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1acd3b80e74fbe8182c437a511b5a1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:22.451153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1acd3b80e74fbe8182c437a511b5a1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:22.466790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1acd3b80e74fbe8182c437a511b5a1'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:22.473732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1134/2265] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:22 2022] DELETE /identity/v3/users/fb1acd3b80e74fbe8182c437a511b5a1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:22.478293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:22.478579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:22.478962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:22.500481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:22.501616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:22.563754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1132/2266] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:22.574388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:22.575909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:22.669387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce09bc-10db-4f42-91c4-9ee15d0a6feb admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:22.676256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:22.676256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:22.676256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:22.676256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:22.686029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:22.687852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4cd1-6861-4d7d-a08f-a11393bb85b5 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:22.700241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1135/2267] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:23.025089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:23.419870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:23.421383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.434271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010e17-9456-4cac-bcde-725aa1a5a249 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:23.439327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:23.440564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:23.440998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:23.441295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] PATH_INFO: `/v3/projects/1c68827d26d849e0828ad3377fcf05ab` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:23.442578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c68827d26d849e0828ad3377fcf05ab)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:23.444904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:23.580575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:23.580987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:23.581426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:23.585640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c68827d26d849e0828ad3377fcf05ab', 'request_id': 'req-d63c3541-8ca5-423d-89c7-aed6a1d860f2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:23.612478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] MFA Rules not processed for user `8eedd053590a4d71b69f1a8f45612c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:23.613705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.679498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c68827d26d849e0828ad3377fcf05ab', 'request_id': 'req-d63c3541-8ca5-423d-89c7-aed6a1d860f2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:23.687347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c68827d26d849e0828ad3377fcf05ab', 'request_id': 'req-d63c3541-8ca5-423d-89c7-aed6a1d860f2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:23.698570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] The token cache is being invalidate because project 1c68827d26d849e0828ad3377fcf05ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:23.698857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:23.699076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1136/2268] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:23.700035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d63c3541-8ca5-423d-89c7-aed6a1d860f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:23.701640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1133/2269] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:23 2022] DELETE /identity/v3/projects/1c68827d26d849e0828ad3377fcf05ab => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:23.705664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:23.707212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77ab4-469d-4613-8b1e-1783d8f6453e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:23.707735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77ab4-469d-4613-8b1e-1783d8f6453e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:23.707962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.708342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77ab4-469d-4613-8b1e-1783d8f6453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:23.732868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-71b77ab4-469d-4613-8b1e-1783d8f6453e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:23.733663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-71b77ab4-469d-4613-8b1e-1783d8f6453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.759578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:23.797150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956d63-5df6-42fb-a794-26bbdd3a0d25 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:23.802985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:23.803800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:23.804161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:23.804500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:23.805200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:23.807581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:23.858024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1134/2270] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:23.862086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:23.862367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:23.862662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:23.907077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:23.908323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.922475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1137/2271] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:23 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:23.922734 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1135/2272] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:23.924910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:23.926728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:23.929447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:23.936376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0db4-a1d4-41a6-8941-37f3c9ce42d7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.037146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.037767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.046876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.046876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.046876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:24.046876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.046876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.047349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9927f-4166-42ab-99dd-a944e583656c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.053118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.053734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.057499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.057499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.057716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1136/2273] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:24.057796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.057796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.058429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.068628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4a664-b7ab-44fe-942d-dd762f453e26 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.073229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.073820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.074097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.074467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.075119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.077101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.171813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1138/2274] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:23 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:24.176394 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.178740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1137/2275] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:24 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:24.182728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.190001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14698-21d5-4b8f-92c3-0bb86159d036 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.252925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.253658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.253974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.254304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.254955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.256766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.266521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b2c0-1c23-46bf-9572-84ab50dc9435 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.273040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1139/2276] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:24.273949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.288713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdbb4e-9f83-48cb-813a-34cc30897cc5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.291884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.292529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.292805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.293078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.293715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.294066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.294847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.296489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.302026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.302345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] PATH_INFO: `/v3/projects/48c407a457ad4675ba3f85cc9a13a09d/users/fc7c7e3185784b9cba8624ea6ded96b8/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.332799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c407a457ad4675ba3f85cc9a13a09d, user_id=fc7c7e3185784b9cba8624ea6ded96b8, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.335081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.424741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1140/2277] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:24 2022] PUT /identity/v3/projects/48c407a457ad4675ba3f85cc9a13a09d/users/fc7c7e3185784b9cba8624ea6ded96b8/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:24.424966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1138/2278] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:24 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:24.428525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.429143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.438854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6199d-be85-4755-accb-6263b9302cfb admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.472299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:24.501093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57d6-9d75-426f-b296-6660f7be5752 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.508002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.508645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.508924 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.509195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.509906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.511489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.521651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.525489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.525628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1141/2279] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:24.525712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.525712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.525712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.525712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.526551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.539115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1139/2280] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:24.539302 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662d9a-4371-46bc-84c9-4e0de44dac56 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.540148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.544460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.544460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.544460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.544460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] PATH_INFO: `/v3/projects/48c407a457ad4675ba3f85cc9a13a09d/users/fc7c7e3185784b9cba8624ea6ded96b8/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.546044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c407a457ad4675ba3f85cc9a13a09d, user_id=fc7c7e3185784b9cba8624ea6ded96b8, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.548736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.549852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ef96-0116-44d6-b285-1957ed265fa0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.554693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.555267 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.555539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.555826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.556451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.558000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23845f51-2f03-4fc0-9307-226caec8bd8f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.559179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1142/2281] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:24 2022] PUT /identity/v3/projects/48c407a457ad4675ba3f85cc9a13a09d/users/fc7c7e3185784b9cba8624ea6ded96b8/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:24.572984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1140/2282] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:24.572984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:24.575891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.642488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4664a-9be1-49a1-89d6-f92f1b68f0c3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:24.648101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:24.648766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.649039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.649309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] PATH_INFO: `/v3/projects/6382ec6a2fb24c40af91796c2d1ddbe4/users/64b60a171d484134a43bb2089a8e93c8/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.664006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6382ec6a2fb24c40af91796c2d1ddbe4, user_id=64b60a171d484134a43bb2089a8e93c8, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:24.666653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:24.794380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1143/2283] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:24 2022] PUT /identity/v3/projects/6382ec6a2fb24c40af91796c2d1ddbe4/users/64b60a171d484134a43bb2089a8e93c8/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:24.805720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:24.806074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:24.806353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:24.836239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] MFA Rules not processed for user `64b60a171d484134a43bb2089a8e93c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:24.836239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:24.902803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1141/2284] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:24.917018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:24.922387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:24.996550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842281c-91f9-4ada-bd67-ee4943e97f16 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:25.000592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:25.001204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:25.001607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:25.001985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:25.012503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:25.013932 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a33bb-2a17-48a4-8d24-7297af3e5396 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:25.030902 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1144/2285] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:25.525277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:25.646876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:25.648350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:25.660553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4344b-2d27-46ad-804c-392e1fb44492 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:25.664635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:25.665442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:25.665571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:25.665816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:25.668116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:25.735601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:25.737112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ffb5-e585-4f60-9f99-b6448a0f2cd8 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:25.747400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1142/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:26.366964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:26.367455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:26.367547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:26.412959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:26.418642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] MFA Rules not processed for user `fc7c7e3185784b9cba8624ea6ded96b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:26.420094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:26.552548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1145/2287] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:26.563076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:26.563365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:26.563637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:26.603767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] MFA Rules not processed for user `8eedd053590a4d71b69f1a8f45612c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:26.605280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:26.717068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1143/2288] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:26.732076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:26.733799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:26.835939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bedfe-1b0e-4b1f-9bee-c89692c60688 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:26.841821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:26.843031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:26.843423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:26.843696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:26.845478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:26.857431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:26.859059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f206e-fe42-4a09-bc1b-0794d06e6a53 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:26.868820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1146/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:26.954544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:28.173545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:28.433426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:29.771514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:29.904606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:30.890857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:31.176733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:31.614044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:32.077828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:32.077828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:32.153820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd05676-58dc-448d-8fd4-f390e0daf278 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:32.158810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:32.159450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:32.160546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:32.160823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] PATH_INFO: `/v3/users/0a1832089b7e46feafee13a353ecc914` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:32.162061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1832089b7e46feafee13a353ecc914)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:32.176905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:32.428188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1832089b7e46feafee13a353ecc914'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:32.429097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1832089b7e46feafee13a353ecc914'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:32.453783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1832089b7e46feafee13a353ecc914'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:32.525154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1832089b7e46feafee13a353ecc914'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:32.546199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1832089b7e46feafee13a353ecc914'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:32.553464 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1144/2290] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:32 2022] DELETE /identity/v3/users/0a1832089b7e46feafee13a353ecc914 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:32.558192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:32.558664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:32.558870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:32.580568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:32.584115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:32.636690 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:32.678274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1147/2291] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:32.679112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:32.680917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:32.745964 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec591-afc8-49bc-a70a-45545c7d12c5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:32.749818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:32.750521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:32.751005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:32.751403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:32.763006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:32.764581 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2e99-f547-4287-b18d-12b25481c57c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:32.775441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1145/2292] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:32.944195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:32.946128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:32.966685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a7b3-3a32-495e-8418-f0a443edf73b None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:32.974746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:32.975472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:32.976120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:32.976469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] PATH_INFO: `/v3/users/319cd6ea1e824adcb45d47b0db9b2e45` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:32.977799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=319cd6ea1e824adcb45d47b0db9b2e45)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:32.979890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:33.169009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319cd6ea1e824adcb45d47b0db9b2e45'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.169699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319cd6ea1e824adcb45d47b0db9b2e45'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.180448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319cd6ea1e824adcb45d47b0db9b2e45'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.246840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319cd6ea1e824adcb45d47b0db9b2e45'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.249546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:33.278968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319cd6ea1e824adcb45d47b0db9b2e45'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.289749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1148/2293] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:32 2022] DELETE /identity/v3/users/319cd6ea1e824adcb45d47b0db9b2e45 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:33.291411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:33.291902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:33.292303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:33.315307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:33.317176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:33.380567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1146/2294] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:33.390382 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:33.392469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:33.438699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:33.440818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:33.462661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94900f-99d7-4ecf-8c1c-066ba383205f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:33.468033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe8ac-ad35-4e60-ba30-d95039c3a3da admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:33.480225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:33.480225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:33.480225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:33.480225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:33.480583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:33.480583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:33.480583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:33.480583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] PATH_INFO: `/v3/projects/51a533e0061f4261ba28e3ae23a77f8e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:33.480912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a533e0061f4261ba28e3ae23a77f8e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:33.480912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:33.487220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:33.506125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:33.538949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1149/2295] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:33.678957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a533e0061f4261ba28e3ae23a77f8e', 'request_id': 'req-20c96dc9-c70a-473d-9709-360420ec9386'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.822716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:33.822716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a533e0061f4261ba28e3ae23a77f8e', 'request_id': 'req-20c96dc9-c70a-473d-9709-360420ec9386'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.828908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a533e0061f4261ba28e3ae23a77f8e', 'request_id': 'req-20c96dc9-c70a-473d-9709-360420ec9386'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.854068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] The token cache is being invalidate because project 51a533e0061f4261ba28e3ae23a77f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:33.854361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.855673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:33.860069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1147/2296] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:33 2022] DELETE /identity/v3/projects/51a533e0061f4261ba28e3ae23a77f8e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:33.864513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:33.880348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0a7da-5049-4f13-9762-a739785e69da service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:33.992655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:33.993749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:33.994284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:33.994708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] PATH_INFO: `/v3/users/f06ff9ee50c3466484182eda8404a484` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:33.996076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06ff9ee50c3466484182eda8404a484)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:34.000134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:34.220452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:34.220452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:34.236728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96dc9-c70a-473d-9709-360420ec9386 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:34.248697 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:34.249628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:34.249909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:34.250186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] PATH_INFO: `/v3/projects/db6adb1ee14044b68a86f4909ffe4268` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:34.251438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6adb1ee14044b68a86f4909ffe4268)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:34.253611 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:34.369441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06ff9ee50c3466484182eda8404a484'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.370531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06ff9ee50c3466484182eda8404a484'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.380319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06ff9ee50c3466484182eda8404a484'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.431065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6adb1ee14044b68a86f4909ffe4268', 'request_id': 'req-08094a54-e718-4c65-826d-e7ebbbc1cc73'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.496523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06ff9ee50c3466484182eda8404a484'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.509588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e49dce82-e73c-4fd4-89e9-7e48e9003d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06ff9ee50c3466484182eda8404a484'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.515484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1150/2297] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:33 2022] DELETE /identity/v3/users/f06ff9ee50c3466484182eda8404a484 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:34.589935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6adb1ee14044b68a86f4909ffe4268', 'request_id': 'req-08094a54-e718-4c65-826d-e7ebbbc1cc73'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.599696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6adb1ee14044b68a86f4909ffe4268', 'request_id': 'req-08094a54-e718-4c65-826d-e7ebbbc1cc73'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.611963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] The token cache is being invalidate because project db6adb1ee14044b68a86f4909ffe4268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:34.612633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.613728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08094a54-e718-4c65-826d-e7ebbbc1cc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:34.615816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1148/2298] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:34 2022] DELETE /identity/v3/projects/db6adb1ee14044b68a86f4909ffe4268 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:34.621177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:34.621177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:34.621177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:34.646607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:34.647846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:34.715388 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1151/2299] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:34.723477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:34.723764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:34.724107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:34.747196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:34.748483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:34.758550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1149/2300] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:34.762980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:34.774837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04b33d-8632-4cc3-bc2c-58016a8dc2a0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:34.780239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:34.781197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:34.781628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:34.782044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:34.783024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:34.783479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:34.785765 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:34.799816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1152/2301] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:42:34.804718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:34.814490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aaa5e-a3b7-4610-b9ad-636da5aa26d0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:34.822841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:34.823568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:34.824053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:34.824374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:34.825223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:34.827222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:34.963810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1150/2302] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:34 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:34.968021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:34.978042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae469-5296-41ba-9835-3edc719e3c2d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.011562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:35.037772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.038373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.044829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.044829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.044829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.044829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.136923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1153/2303] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:34 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:35.141112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.151711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b8c4b-372e-49c2-9090-434124039f70 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.156828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.157682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.162304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.162304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.162304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.162304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.178198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:35.180593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1151/2304] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:35.184545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.194805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebe74-d15e-4547-8bfe-d6ba352d3851 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.200228 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.200859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.201254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.201528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.202173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.203736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.209607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.216404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1154/2305] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:35.219498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.223026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.236824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee77f0-a1b7-4fb6-ac7a-e22d080a1a45 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.245552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.245844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.246025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.246297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] PATH_INFO: `/v3/projects/25fd64c5f3c348579ecfa06d6ddb986e/users/d55c162e5e13490aaaf8e94951a55c09/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.263000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7da8c-1c37-4a26-95a6-607b376cd107 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.266309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fd64c5f3c348579ecfa06d6ddb986e, user_id=d55c162e5e13490aaaf8e94951a55c09, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.270113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e77fc8-8301-4f0d-b0ad-dd88e9146465 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.276986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.277632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.277958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.278228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] PATH_INFO: `/v3/projects/ed160d0041884962aeb17c36c422ddbb` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.279487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed160d0041884962aeb17c36c422ddbb)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.281479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.344166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1155/2306] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:35 2022] PUT /identity/v3/projects/25fd64c5f3c348579ecfa06d6ddb986e/users/d55c162e5e13490aaaf8e94951a55c09/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:35.349830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.350116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.350383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.369992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:35.371183 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.424721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed160d0041884962aeb17c36c422ddbb', 'request_id': 'req-1e208d07-5112-4e1a-ab74-9eee629b7356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:35.448212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1156/2307] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:35.479207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.480823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.551520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea79c4-caf9-45a0-a20a-cb89de7651fc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.553977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed160d0041884962aeb17c36c422ddbb', 'request_id': 'req-1e208d07-5112-4e1a-ab74-9eee629b7356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:35.563251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed160d0041884962aeb17c36c422ddbb', 'request_id': 'req-1e208d07-5112-4e1a-ab74-9eee629b7356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:35.580642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] The token cache is being invalidate because project ed160d0041884962aeb17c36c422ddbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:35.581174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:35.582897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e208d07-5112-4e1a-ab74-9eee629b7356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:35.585766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1152/2308] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:35 2022] DELETE /identity/v3/projects/ed160d0041884962aeb17c36c422ddbb => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:35.592828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2ef1-c9d6-4597-9df4-9109eecba1a6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.598398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2ef1-c9d6-4597-9df4-9109eecba1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.598398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2ef1-c9d6-4597-9df4-9109eecba1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.621231 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-798c2ef1-c9d6-4597-9df4-9109eecba1a6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:35.626075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-798c2ef1-c9d6-4597-9df4-9109eecba1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.628032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.628696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.628973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.629344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.647391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.711109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1153/2309] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:35.720426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.720789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.721134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.727972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.729429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.738984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1157/2310] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:35.743910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:35.745765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:35.754970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1154/2311] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:35.759470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.774097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520e7e-3906-46f7-b703-c3355fde1a92 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.781187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.782098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.786200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.786200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.786200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:35.786200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.786918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.799749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1158/2312] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:35.804578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.813842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d8ce-4e29-4694-923b-05baeae2a96c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:35.818624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:35.819212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:35.819483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:35.819747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:35.820394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:35.822268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:35.909755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1155/2313] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:35 2022] POST /identity/v3/projects => generated 359 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:35.913579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:35.926731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a827e-a09e-480d-a65a-92adcecc3cf6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.012300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.012913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.013154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.013417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.014041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.015940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:36.132411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1159/2314] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:35 2022] POST /identity/v3/users => generated 280 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:42:36.134393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:36.148641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc613a-d57d-461e-902b-711fde891e21 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.153689 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.154427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.154921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.155691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.156473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.158165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:36.172210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1156/2315] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:36.176465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:36.193203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c134-d48a-4b62-a5e1-5e5d066f554e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.208186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.210392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.210392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.210392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.211383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.213544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b661693-81e4-4949-af7b-5ccb68d83bd5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:36.225755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1160/2316] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:42:36.230502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:36.247673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bba08-552b-405a-b8ff-c2720eb6d17d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.250467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.251212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.251699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.252086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] PATH_INFO: `/v3/projects/4ea3c6e6d95c41c49d902f88eefbd313/users/48f10f5783454857ac2e13d33dec1e7f/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.275502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea3c6e6d95c41c49d902f88eefbd313, user_id=48f10f5783454857ac2e13d33dec1e7f, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.278499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:36.420677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1157/2317] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:36 2022] PUT /identity/v3/projects/4ea3c6e6d95c41c49d902f88eefbd313/users/48f10f5783454857ac2e13d33dec1e7f/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:36.433350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.433856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.434475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.494650 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] MFA Rules not processed for user `48f10f5783454857ac2e13d33dec1e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:36.496421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:36.621956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1161/2318] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:36.695005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:36.697468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:36.760561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeeece-dd71-48e0-bf21-04d3628f5534 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.764123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.764761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.765037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.765310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.774369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.776914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900283-6496-4b90-9cd0-1eb6d562ed7a service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:36.788878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1158/2319] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:36.804792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:36.893538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a6bd9-7637-4890-a3fa-40bd85adcce4 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:36.901946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:36.905426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:36.905426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:36.905426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] PATH_INFO: `/v3/users/48f10f5783454857ac2e13d33dec1e7f` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:36.905426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f10f5783454857ac2e13d33dec1e7f)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:36.906492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:37.100611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f10f5783454857ac2e13d33dec1e7f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.101294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f10f5783454857ac2e13d33dec1e7f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.108549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f10f5783454857ac2e13d33dec1e7f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.184371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f10f5783454857ac2e13d33dec1e7f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.187062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:37.200397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f10f5783454857ac2e13d33dec1e7f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.206970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1162/2320] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:36 2022] DELETE /identity/v3/users/48f10f5783454857ac2e13d33dec1e7f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:37.212623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e8d-8882-42c8-bd4e-1583abb96c0e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.213278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e8d-8882-42c8-bd4e-1583abb96c0e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.213578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f445e8d-8882-42c8-bd4e-1583abb96c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.234614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6f445e8d-8882-42c8-bd4e-1583abb96c0e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:37.235344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6f445e8d-8882-42c8-bd4e-1583abb96c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.305657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1159/2321] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:37.316944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:37.318474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.379278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dce72-92d9-44bd-a698-25d033c40abf admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:37.383060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:37.383678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.383996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.384274 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.394377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:37.395864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:37.396336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:37.405977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1163/2322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:37.549897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.551952 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.552397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.578237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:37.580277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.588850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] MFA Rules not processed for user `d55c162e5e13490aaaf8e94951a55c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:37.590498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.599691 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1be6-ed8c-4872-8b29-4688794e1273 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:37.619367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:37.620051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.620332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.620608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] PATH_INFO: `/v3/users/64b60a171d484134a43bb2089a8e93c8` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.626061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b60a171d484134a43bb2089a8e93c8)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:37.633866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:37.694108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1160/2323] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:37.707296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:37.710318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.793846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72114a1-8d20-4099-baf7-1749cb137a40 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:37.798429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:37.799097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.799374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.799672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.810193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:37.811941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b55d-c148-4bcf-9316-ca83ddb7534a service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:37.822259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1161/2324] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:37.848928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b60a171d484134a43bb2089a8e93c8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.849966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b60a171d484134a43bb2089a8e93c8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.860253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b60a171d484134a43bb2089a8e93c8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.913808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b60a171d484134a43bb2089a8e93c8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.936704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b60a171d484134a43bb2089a8e93c8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:37.952868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1164/2325] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:42:37 2022] DELETE /identity/v3/users/64b60a171d484134a43bb2089a8e93c8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:37.958632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:37.960941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:37.961395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:37.987466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:37.990619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:37.997534 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:37.999681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:38.116946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b779c3-2fc9-4872-a82d-7eb781af8330 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.122699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.123561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.124367 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.124849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] PATH_INFO: `/v3/projects/4ea3c6e6d95c41c49d902f88eefbd313` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.126358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea3c6e6d95c41c49d902f88eefbd313)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.128497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.139384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1162/2326] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:38.164890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.168378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:38.178437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:38.255936 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb041f3-6b88-46ac-ba05-8cb599af54c3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.256405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea3c6e6d95c41c49d902f88eefbd313', 'request_id': 'req-f356b42f-d35b-42b9-a435-cad4951b1a7e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:38.269608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea3c6e6d95c41c49d902f88eefbd313', 'request_id': 'req-f356b42f-d35b-42b9-a435-cad4951b1a7e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:38.326131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.326845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.327204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.327536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.391105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.392669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4769-47a7-4a1d-a0f1-98c059aedf03 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.393370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea3c6e6d95c41c49d902f88eefbd313', 'request_id': 'req-f356b42f-d35b-42b9-a435-cad4951b1a7e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:38.407320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] The token cache is being invalidate because project 4ea3c6e6d95c41c49d902f88eefbd313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:38.408138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:38.408910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1163/2327] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:38.409280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f356b42f-d35b-42b9-a435-cad4951b1a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:38.411908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1165/2328] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:37 2022] DELETE /identity/v3/projects/4ea3c6e6d95c41c49d902f88eefbd313 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:38.418442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.418812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.419096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.442589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:38.443875 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:38.452254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1164/2329] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:38.461582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.461940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.462342 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.485662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:38.486518 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:38.496067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1166/2330] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:38.501043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.511659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ffdc-a297-4dea-ba8d-cb331aaf6792 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.516618 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.517238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.517514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.517783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.518433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:38.518821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.521108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.533670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1165/2331] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:38.538753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.548408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eea74-c9c8-45a2-81e4-b913c49bc5bc None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.554570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.555178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.555458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.555726 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.556402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.558478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.717682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1167/2332] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:38 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:38.719488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.731519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918042-4d64-4079-85ad-7c58f4bb04a7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.783977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:38.798776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.799384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.799682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.800538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.801157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.803187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1d432-ebe2-4da1-834d-e05736bdcaa5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.938044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1166/2333] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:38 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:38.941558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.952182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929b08e-3ea3-470f-b6af-dbb05dd15640 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.957688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:38.958381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.958658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.958926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.959570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:38.961205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:38.971857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1168/2334] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:38.975060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624320d1-c9be-48e8-b4b3-873442a6a215 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:38.979382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624320d1-c9be-48e8-b4b3-873442a6a215 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:38.979382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624320d1-c9be-48e8-b4b3-873442a6a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:38.983865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:38.994628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ac6bc-3928-4dd9-9479-c07999538a7c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:38.997555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-624320d1-c9be-48e8-b4b3-873442a6a215 None None] MFA Rules not processed for user `b51ab52dfba64392ad65d894c6dadb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:39.016749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:39.016905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:39.017022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-624320d1-c9be-48e8-b4b3-873442a6a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:39.017115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1169/2335] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:39.020590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:39.030792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5cdb-ad10-43ac-b8fc-f9db38d26533 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:39.035882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:39.036537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.039922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.039922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] PATH_INFO: `/v3/projects/e9dffae44b954a54866772bcc4e9d60a/users/2e7133f18b124c7f9605a83f855e9fc8/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.054638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9dffae44b954a54866772bcc4e9d60a, user_id=2e7133f18b124c7f9605a83f855e9fc8, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:39.057507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:39.063472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1167/2336] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:39.139102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1170/2337] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:39 2022] PUT /identity/v3/projects/e9dffae44b954a54866772bcc4e9d60a/users/2e7133f18b124c7f9605a83f855e9fc8/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:42:39.144923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.145376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.145793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.166526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:39.168003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:39.250358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1168/2338] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:39.260563 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:39.262848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:39.336775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1ea24-159d-458a-a8c4-7469c08c2b91 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:39.340803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:39.341619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.341991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.342335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.352739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:39.354610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e17f2-b71d-45da-9356-7a261aa6db0e service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:39.366863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1171/2339] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:39.598909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:39.600512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:39.613311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021aad-185b-4dfb-8e93-7389cd1aaeb8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:39.619331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:39.620304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.620682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.621148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] PATH_INFO: `/v3/projects/6382ec6a2fb24c40af91796c2d1ddbe4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.622463 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6382ec6a2fb24c40af91796c2d1ddbe4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:39.625307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:39.788780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6382ec6a2fb24c40af91796c2d1ddbe4', 'request_id': 'req-8fa29843-5bd0-47d5-9519-30ed2a182480'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:39.841161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:39.841437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:39.841705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:39.860653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] MFA Rules not processed for user `d55c162e5e13490aaaf8e94951a55c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:39.861847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:39.876406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6382ec6a2fb24c40af91796c2d1ddbe4', 'request_id': 'req-8fa29843-5bd0-47d5-9519-30ed2a182480'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:39.887036 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6382ec6a2fb24c40af91796c2d1ddbe4', 'request_id': 'req-8fa29843-5bd0-47d5-9519-30ed2a182480'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:39.919105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] The token cache is being invalidate because project 6382ec6a2fb24c40af91796c2d1ddbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:42:39.920306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:39.922177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fa29843-5bd0-47d5-9519-30ed2a182480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:42:39.926150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1169/2340] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:42:39 2022] DELETE /identity/v3/projects/6382ec6a2fb24c40af91796c2d1ddbe4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:40.021356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1172/2341] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:41.442826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:41.710110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-de5f-4191-959b-85e1f79bc95a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:41.711233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-de5f-4191-959b-85e1f79bc95a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:41.712272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb2b4-de5f-4191-959b-85e1f79bc95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:41.744455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6e3bb2b4-de5f-4191-959b-85e1f79bc95a None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:41.746319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6e3bb2b4-de5f-4191-959b-85e1f79bc95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:41.827625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1170/2342] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:41.896667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:41.898965 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:41.997897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4876d4a-8f63-47f7-b154-2dce28d75015 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:42.005324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:42.006000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:42.006287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:42.006561 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:42.016566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:42.018407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:42.038962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:42.047042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1173/2343] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:42:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:42:44.610958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:45.073107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:45.525315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:51.605543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:51.606662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:51.607146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:51.692733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] MFA Rules not processed for user `2e7133f18b124c7f9605a83f855e9fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:51.694255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:51.704898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:51.854099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1171/2344] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:51.854884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:51.856335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:52.008200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17109b9-1f2f-475f-a19c-4216b00c2e00 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.015526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.019988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.019988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.019988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.019988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.025790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.192127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1174/2345] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:52.195519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.218444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404477-9f1b-48f2-b95d-5cfbd7a45fea None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.339763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.341969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:52.346248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.347068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.347352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.347889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.348563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.350792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.374590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:52.417613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970313-2993-43ab-b49a-fd0c569abd67 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.423981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.429405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.429817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.430029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.433662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:52.460924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1172/2346] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:52 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:52.466705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.483530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e62d-4619-49dd-9314-e30de3bee8c8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.491127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.492052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.492532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.492998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.494470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.496528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.511701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1173/2347] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:52.520034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.563910 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf2cd7-1c56-4c18-94ec-2b8548179026 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.565366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.565460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.565565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.565770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.565770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.565770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] PATH_INFO: `/v3/projects/05a5a5055aaf46fc987c600e05051b79/users/9036f0ce6bd742e88bc91d4344716766/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.565986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1175/2348] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:42:52.583878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a5a5055aaf46fc987c600e05051b79, user_id=9036f0ce6bd742e88bc91d4344716766, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.583878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.690918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1174/2349] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:52 2022] PUT /identity/v3/projects/05a5a5055aaf46fc987c600e05051b79/users/9036f0ce6bd742e88bc91d4344716766/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:52.695240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.717929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1bcbc-d290-4a40-8c95-f46994cf20f5 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.830459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.831854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.832270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.832478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.833555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.835239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26969b-08b0-4eaa-bdca-cb3c92ad96c2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.868413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1176/2350] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:52.869020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:52.885216 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483755-5c5c-4a0b-a7a0-8aa8f2af9815 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:52.891565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:52.892389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:52.892767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:52.893139 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] PATH_INFO: `/v3/projects/05a5a5055aaf46fc987c600e05051b79/users/9036f0ce6bd742e88bc91d4344716766/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:52.895987 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a5a5055aaf46fc987c600e05051b79, user_id=9036f0ce6bd742e88bc91d4344716766, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:52.898845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:52.914053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1175/2351] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:52 2022] PUT /identity/v3/projects/05a5a5055aaf46fc987c600e05051b79/users/9036f0ce6bd742e88bc91d4344716766/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:02.407923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446810-7385-44ab-b713-19ca3c9ad9cb None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.408428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446810-7385-44ab-b713-19ca3c9ad9cb None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.408623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19446810-7385-44ab-b713-19ca3c9ad9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.481715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-19446810-7385-44ab-b713-19ca3c9ad9cb None None] MFA Rules not processed for user `9036f0ce6bd742e88bc91d4344716766`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:02.484094 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-19446810-7385-44ab-b713-19ca3c9ad9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:02.620776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:02.655970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1177/2352] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:02.665132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:02.667691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:02.767928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:02.813447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3c57-1666-40c4-98b0-783d6a2968a4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:02.826569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:02.827203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.827482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.827762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.953959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:02.958922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be138a1-d62f-4a57-9e5a-35e115a8ad33 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:02.984404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1176/2353] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:06.599063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418ff46-f260-4fcb-b37c-668eeab54a3a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:06.599648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418ff46-f260-4fcb-b37c-668eeab54a3a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:06.599648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418ff46-f260-4fcb-b37c-668eeab54a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:06.624496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c418ff46-f260-4fcb-b37c-668eeab54a3a None None] MFA Rules not processed for user `2e7133f18b124c7f9605a83f855e9fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:06.625937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c418ff46-f260-4fcb-b37c-668eeab54a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:06.634923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1178/2354] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:08.974411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.975266 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.980912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.986274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1177/2355] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:43:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:08.992361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.993891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.994330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.020139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:09.022194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:09.034999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1179/2356] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:13.072659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=35 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:19.010229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=10 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:21.001269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.003323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.064471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba37be-9ee2-4d34-a919-1d881805d905 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.069120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.069724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.070000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.070272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.084184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.085628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fbd87-d9b6-480c-a68d-ac4b48769721 service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.096777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1178/2357] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:21.228538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.230480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.318336 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01236c6-03fe-49f9-93f2-70306cec69be None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.322838 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.323575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.323873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.324148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] PATH_INFO: `/v3/users/8eedd053590a4d71b69f1a8f45612c1b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.325358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eedd053590a4d71b69f1a8f45612c1b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.327225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.360004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86a2e-151f-445f-90af-826a904325fa None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.360290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86a2e-151f-445f-90af-826a904325fa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.360564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86a2e-151f-445f-90af-826a904325fa None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.361940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1179/2358] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:43:21.366424 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.366700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.366968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.387641 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:21.388889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.442619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1180/2359] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:21.455355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.459306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.467094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e410b-2772-44d9-95c3-b9951f53b85b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.470810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.471418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.471700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.472574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.479855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.481273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4ed2f-92bb-41b9-aa6a-a299898f7ce5 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.490373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1181/2360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:21.506473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eedd053590a4d71b69f1a8f45612c1b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.507157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eedd053590a4d71b69f1a8f45612c1b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.522247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eedd053590a4d71b69f1a8f45612c1b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.578591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045edd8-77dd-4977-a1b7-b843dc3b299b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.578878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045edd8-77dd-4977-a1b7-b843dc3b299b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.579419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045edd8-77dd-4977-a1b7-b843dc3b299b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.580808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1182/2361] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:43:21.586436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.586728 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.586997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.607185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:21.608406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.617623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eedd053590a4d71b69f1a8f45612c1b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.619538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1183/2362] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:21.632401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eedd053590a4d71b69f1a8f45612c1b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.632882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.634932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.638914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1180/2363] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:21 2022] DELETE /identity/v3/users/8eedd053590a4d71b69f1a8f45612c1b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:21.647531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0096f77-bc4f-44b6-8600-4306958049c9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.703078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.703706 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.704282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.704576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.759007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:21.782736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.784217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.796841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1184/2364] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:21.936978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.938545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:22.039232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932ffc-698b-48f3-a58a-1c9c5be2fff7 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:22.044696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:22.045649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.046041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.046756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] PATH_INFO: `/v3/projects/4a142857cc9d4c1fbd5d3eccc3984de4` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.048389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a142857cc9d4c1fbd5d3eccc3984de4)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:22.051384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:22.077462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:22.195120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a142857cc9d4c1fbd5d3eccc3984de4', 'request_id': 'req-0d99c04e-fe31-45b0-924a-8a84df3a79f8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.202124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a142857cc9d4c1fbd5d3eccc3984de4', 'request_id': 'req-0d99c04e-fe31-45b0-924a-8a84df3a79f8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.289199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a142857cc9d4c1fbd5d3eccc3984de4', 'request_id': 'req-0d99c04e-fe31-45b0-924a-8a84df3a79f8'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.315064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] The token cache is being invalidate because project 4a142857cc9d4c1fbd5d3eccc3984de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:22.315596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.316456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.319630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1181/2365] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:21 2022] DELETE /identity/v3/projects/4a142857cc9d4c1fbd5d3eccc3984de4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:22.323528 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:22.336815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c947-a380-46ac-8dfc-b25813a92c67 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:22.403065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:22.403688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.403992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.404258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] PATH_INFO: `/v3/users/fc7c7e3185784b9cba8624ea6ded96b8` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.405372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7c7e3185784b9cba8624ea6ded96b8)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:22.407303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:22.614311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7c7e3185784b9cba8624ea6ded96b8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.614891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7c7e3185784b9cba8624ea6ded96b8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.626916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7c7e3185784b9cba8624ea6ded96b8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.708994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7c7e3185784b9cba8624ea6ded96b8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.717254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ecc03145-63c2-45ca-97dd-db27ea577722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7c7e3185784b9cba8624ea6ded96b8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.723232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1185/2366] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:22 2022] DELETE /identity/v3/users/fc7c7e3185784b9cba8624ea6ded96b8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:23.005008 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.006979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.020714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99c04e-fe31-45b0-924a-8a84df3a79f8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.090285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.090910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.091187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.091455 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] PATH_INFO: `/v3/projects/48c407a457ad4675ba3f85cc9a13a09d` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.092645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c407a457ad4675ba3f85cc9a13a09d)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.094614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.233759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c407a457ad4675ba3f85cc9a13a09d', 'request_id': 'req-a4688c0c-d818-49cc-8221-d329744b36a9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.244287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c407a457ad4675ba3f85cc9a13a09d', 'request_id': 'req-a4688c0c-d818-49cc-8221-d329744b36a9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.329540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c407a457ad4675ba3f85cc9a13a09d', 'request_id': 'req-a4688c0c-d818-49cc-8221-d329744b36a9'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.341036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] The token cache is being invalidate because project 48c407a457ad4675ba3f85cc9a13a09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:23.341328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.341958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a4688c0c-d818-49cc-8221-d329744b36a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.343440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1182/2367] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:23 2022] DELETE /identity/v3/projects/48c407a457ad4675ba3f85cc9a13a09d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:23.348338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.348793 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.348977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.368850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.370041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.426852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:23.439839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1186/2368] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:23.448395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.448694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.448989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.469927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.471163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.480756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1183/2369] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:23.485365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.495625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d27005-7008-48af-8edf-fb4e70fce56d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.500290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.504564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.516129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1187/2370] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:43:23.520488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.530082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90498-0a7b-4551-82de-7b2a4b8f884f None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.534855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.535447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.535721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.536024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.536761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.538646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.617392 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1184/2371] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:23.621770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.632608 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb90d4-59bf-4ecb-86de-feb58bf3797e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.691416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.692061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.692340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.692614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.693652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.695615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.773578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1188/2372] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:23.780750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.791867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4cbb5-23b5-41fe-9501-5ecf800389ee admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.796717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.797303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.797574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.797837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.798466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.800064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.807237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:23.812627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1185/2373] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:23.816777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.826918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e821-cee0-4c67-a78e-4231dcca16e1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.832606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.833108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.833826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.834011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.834736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.836435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f079b1-2617-4c21-8016-bbbc1733e176 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.848019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1189/2374] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:23.853226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.863453 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15be0-e237-4933-ac60-0327157cfde5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.868945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.869600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.869883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.873312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] PATH_INFO: `/v3/projects/c0585e11f4b847b380a7508da4ecd8b6/users/b519df9482d6467e91c8d385fbebd0a6/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.885490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0585e11f4b847b380a7508da4ecd8b6, user_id=b519df9482d6467e91c8d385fbebd0a6, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.888768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.986848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1186/2375] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:23 2022] PUT /identity/v3/projects/c0585e11f4b847b380a7508da4ecd8b6/users/b519df9482d6467e91c8d385fbebd0a6/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:23.996874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dbe79-9d49-4149-b16f-ab3b57cfce01 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.997160 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dbe79-9d49-4149-b16f-ab3b57cfce01 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.997437 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dbe79-9d49-4149-b16f-ab3b57cfce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.026623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-929dbe79-9d49-4149-b16f-ab3b57cfce01 None None] MFA Rules not processed for user `b519df9482d6467e91c8d385fbebd0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:24.028034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-929dbe79-9d49-4149-b16f-ab3b57cfce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:24.097273 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1190/2376] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:24.108740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.110460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:24.172292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3589-9133-4510-83dc-8fbeda8dd140 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.175988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.176592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.176876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.177176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.185651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.187091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.196262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1187/2377] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:25.505807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa13c2-63b2-48cb-b83b-98a6eea94e5c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.506560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa13c2-63b2-48cb-b83b-98a6eea94e5c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.506560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa13c2-63b2-48cb-b83b-98a6eea94e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.527507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8ffa13c2-63b2-48cb-b83b-98a6eea94e5c None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:25.529033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8ffa13c2-63b2-48cb-b83b-98a6eea94e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.577674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:25.591891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1191/2378] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:25.608234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.610451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.695291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1689c9-3080-4e29-9eef-92318a81522e service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.700432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.701034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.701301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.701579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.711169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.712860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.721276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1188/2379] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:43:25.899944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.900278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.900554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.922684 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] MFA Rules not processed for user `b519df9482d6467e91c8d385fbebd0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:25.924177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.932907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1192/2380] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:35.718286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.062989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:37.361303 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.362811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.404026 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.405859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.495207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c63-3e2f-4845-b9f2-d604cf8df8fb service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.511508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.512209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.512483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.512750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.516104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.525037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d0fc-4c91-4bf4-a55e-d43731978fa0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.532134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.532849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.533352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.533736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.540444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.544839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.545444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.547219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07355-8620-4159-a98f-a81bea800fdc service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.570969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1193/2381] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:37.574981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1189/2382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:43.064002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb2a0-27c6-4d22-bfff-25f519551e48 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:43.064809 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb2a0-27c6-4d22-bfff-25f519551e48 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:43.065088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb2a0-27c6-4d22-bfff-25f519551e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:43.086104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f67cb2a0-27c6-4d22-bfff-25f519551e48 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:43.087320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f67cb2a0-27c6-4d22-bfff-25f519551e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:43.164193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1194/2383] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:43.186639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:43.188093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:43.284699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29b62-f65c-4dab-8ee2-3af5847e42d8 service placement] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:43.291461 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:43.292730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:43.293227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:43.296611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:43.312395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:43.312395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:43.341322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1190/2384] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:43.378207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a919-a14a-4c17-8f2c-510735144bfe None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:43.378606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a919-a14a-4c17-8f2c-510735144bfe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:43.379048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a919-a14a-4c17-8f2c-510735144bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:43.403037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6804a919-a14a-4c17-8f2c-510735144bfe None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:43.405257 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6804a919-a14a-4c17-8f2c-510735144bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:43.421340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1195/2385] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:43:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:43.441811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:43.454551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084347e-21f8-4b31-8ac9-63699b7b37f5 service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:43.460506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:43.461229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:43.461969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:43.461969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:43.470975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:43.472679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:43.483312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1191/2386] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:43:48.202173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b98f-74f1-42de-904a-2fd74221a977 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.202760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b98f-74f1-42de-904a-2fd74221a977 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.202760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b98f-74f1-42de-904a-2fd74221a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.223246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b102b98f-74f1-42de-904a-2fd74221a977 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:48.225069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b102b98f-74f1-42de-904a-2fd74221a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.233202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1196/2387] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:48.247044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.249319 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.264417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4b14-bf31-45f7-8880-ddf59690fa30 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.269801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.271152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.271601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.271911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.280241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.281837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.292042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1192/2388] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:58.218084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=65 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:58.287931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=78 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.153100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.153373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.153804 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.180362 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:59.181856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.193413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1197/2389] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:59.217940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.233407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec0e8-89a7-4aa3-b2b6-e5f5bde1b63a service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.239646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.241230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.241625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.241983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.251054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.252767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f662e-6484-483a-bd41-247086201cac service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.263214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1193/2390] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:59.420058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.420058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.474286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eedd5-bfba-4959-89c9-b6a467c7371a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.477931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.478529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.478806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.479076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.480949 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.543670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.545644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10672dfd-6127-4db7-a1b8-7c86ac64dc36 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.555563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1198/2391] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:05.549033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:05.549033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:05.549033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:05.574642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] MFA Rules not processed for user `7e35335d035c44daaf79627c255e9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:05.575900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:05.634168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1194/2392] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:06.008724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bef9-6eb1-41ad-b204-3fd081076240 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.009189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bef9-6eb1-41ad-b204-3fd081076240 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.009450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bef9-6eb1-41ad-b204-3fd081076240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.035473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7d45bef9-6eb1-41ad-b204-3fd081076240 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:06.036733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7d45bef9-6eb1-41ad-b204-3fd081076240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:06.045808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1199/2393] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:06.068715 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:06.081844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453005f-8a36-45cb-bb96-e1cf407347f0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:06.088190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:06.088920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.089201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.089472 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.097985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:06.099628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:06.110232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1195/2394] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:06.947496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68679-f51a-4ce7-be04-22485b8fd56d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.951123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68679-f51a-4ce7-be04-22485b8fd56d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.951123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68679-f51a-4ce7-be04-22485b8fd56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.967890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6ba68679-f51a-4ce7-be04-22485b8fd56d None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:06.969099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6ba68679-f51a-4ce7-be04-22485b8fd56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:06.976386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1200/2395] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:06.988291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:06.999652 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8279-556a-459e-9a57-584a6271b96a service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.004634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.005218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.005492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.006421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.014792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.016402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.033949 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1196/2396] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:44:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:44:07.994176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42b80-8897-4932-8893-6de9f9b8a6d9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.994686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42b80-8897-4932-8893-6de9f9b8a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.994834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b42b80-8897-4932-8893-6de9f9b8a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.013548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-36b42b80-8897-4932-8893-6de9f9b8a6d9 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:08.014753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-36b42b80-8897-4932-8893-6de9f9b8a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.022293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1201/2397] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:08.034754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.048741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf79ea-3ff4-4ddf-9720-382594a5aebb service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.054235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.054886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.055160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.055427 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.072623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.072623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.078752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1197/2398] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:44:08.695472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caacdef-448c-4256-887a-684a07913ed1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.703040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caacdef-448c-4256-887a-684a07913ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.703040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caacdef-448c-4256-887a-684a07913ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.716965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8caacdef-448c-4256-887a-684a07913ed1 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:08.718156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8caacdef-448c-4256-887a-684a07913ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.725304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1202/2399] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:08.737504 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.747967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c11ae-ab8d-4a29-8bf4-97c3db675fa5 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.753071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.753658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.753929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.754194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.762945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.766025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.773365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1198/2400] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:44:09.394558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a245-c255-4b61-8b8f-f849be232b83 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.395043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a245-c255-4b61-8b8f-f849be232b83 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.395284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a245-c255-4b61-8b8f-f849be232b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.418889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cc82a245-c255-4b61-8b8f-f849be232b83 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:09.420217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cc82a245-c255-4b61-8b8f-f849be232b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:09.428717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1203/2401] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:09.448503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:09.461514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaca58-277a-48f1-b83b-9532827d20d7 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:09.467425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:09.468235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.468857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.469133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.480421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:09.482239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:09.500015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1199/2402] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:44:10.365100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.365100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.365100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.377204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:10.378427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.387676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1204/2403] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:10.403935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.418051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25532cfe-6e6d-4f33-930b-d3039142ee65 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.425134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.425815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.426198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.426551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.435971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.438082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cb793-bbc4-467a-a70c-5c7711014a13 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.448538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1200/2404] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:12.439970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.451022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee554b11-a79a-4715-9773-dc630ecae125 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.462192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.462834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.463108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.463394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] PATH_INFO: `/v3/users/b519df9482d6467e91c8d385fbebd0a6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.464540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b519df9482d6467e91c8d385fbebd0a6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.466527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.687099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b519df9482d6467e91c8d385fbebd0a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.687752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b519df9482d6467e91c8d385fbebd0a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.696082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:12.700478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b519df9482d6467e91c8d385fbebd0a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.843110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b519df9482d6467e91c8d385fbebd0a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.850911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b519df9482d6467e91c8d385fbebd0a6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.856989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1205/2405] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:12 2022] DELETE /identity/v3/users/b519df9482d6467e91c8d385fbebd0a6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:12.861469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.861948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.862045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.881839 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:12.883035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.940264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1201/2406] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:12.951071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.952512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.011006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ae79-54f0-4764-8fe4-ef5e0fb793ae admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.014824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.015466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.015747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.016076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.026264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.029759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141dd42-afe0-44f0-b200-d1ede214f64c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.037787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1206/2407] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:13.433259 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.434727 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.453489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b12cde-21cc-497c-a976-254d0b3945ec None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.455256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.455910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.456194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.456387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] PATH_INFO: `/v3/projects/c0585e11f4b847b380a7508da4ecd8b6` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.457670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0585e11f4b847b380a7508da4ecd8b6)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.459861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.469479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=100 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.560953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0585e11f4b847b380a7508da4ecd8b6', 'request_id': 'req-bfb240d4-533b-4eed-9091-9335697a1938'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.567348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0585e11f4b847b380a7508da4ecd8b6', 'request_id': 'req-bfb240d4-533b-4eed-9091-9335697a1938'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.598878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.599369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.599480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.619321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.620564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.638658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0585e11f4b847b380a7508da4ecd8b6', 'request_id': 'req-bfb240d4-533b-4eed-9091-9335697a1938'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.650498 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] The token cache is being invalidate because project c0585e11f4b847b380a7508da4ecd8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:13.650871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.651485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-bfb240d4-533b-4eed-9091-9335697a1938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.653486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1202/2408] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:13 2022] DELETE /identity/v3/projects/c0585e11f4b847b380a7508da4ecd8b6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:13.658147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43235ee-a690-48d0-88d6-98a219b3234a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.658428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43235ee-a690-48d0-88d6-98a219b3234a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.658826 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43235ee-a690-48d0-88d6-98a219b3234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.678917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c43235ee-a690-48d0-88d6-98a219b3234a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.680176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c43235ee-a690-48d0-88d6-98a219b3234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.682982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1207/2409] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:13.688559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1203/2410] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:13.714681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.716310 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.754644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.754905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.755175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.774737 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.775963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.783754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1204/2411] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:13.788330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.797410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e2b4e-4ca9-4d40-9ba2-2292c1510474 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.797725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2ccc1-1a18-4ee7-be8b-ae8568dc7d47 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.802014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.802589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.802870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.803776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.803956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.804404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.804583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:13.804679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.804887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.804980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.806459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.813004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.814563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.818143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1205/2412] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:13.822688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.825633 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1208/2413] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:13.832819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28657e9f-c8bf-402e-b4cb-71e10b1ea0ff admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.837874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.838457 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.838734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.839003 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.839617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.841535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.958100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1206/2414] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:13.962439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.968616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.972485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0163-fd98-4234-abbc-aa680ac2ffdf service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.029557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.030162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.030445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.030721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.031340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.033280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.133676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1209/2415] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:14.138078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.149355 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e11-febe-4018-ac47-8c4039dc1ae4 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.154036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.154631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.154911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.155185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.155853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.157445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.168332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1207/2416] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:14.172484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.182639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a225a89-56c4-4f58-bca2-421790691794 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.187599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.188209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.188514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.188787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.189422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.191011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfae86-481e-4a4a-b546-59e50f87be7a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.201280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1210/2417] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:44:14.205601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.216633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9cf0c-22e3-4964-a70f-472e4063aee3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.221639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.222283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.222562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.222836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] PATH_INFO: `/v3/projects/ba5180b2618e47c1b7fe250b0492e6dd/users/969c049b9b8744cbb670b7eb62c05e80/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.237980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5180b2618e47c1b7fe250b0492e6dd, user_id=969c049b9b8744cbb670b7eb62c05e80, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.240730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.362930 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1208/2418] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:14 2022] PUT /identity/v3/projects/ba5180b2618e47c1b7fe250b0492e6dd/users/969c049b9b8744cbb670b7eb62c05e80/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:14.369021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.369440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.369651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.400138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] MFA Rules not processed for user `969c049b9b8744cbb670b7eb62c05e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:14.401390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.469753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1211/2419] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:14.481432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.483212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.543400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067864a-f153-48ac-b4cd-9cd739e17141 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.547047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.547642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.547951 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.548219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.556734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.558215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026c02f-dc29-4fd9-94f1-bc24ec5ca40f service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.566974 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1209/2420] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:20.421204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:20.484704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec91a-7388-485b-b587-2027fcd0b5cc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:20.489222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:20.489841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:20.490123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:20.490485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] PATH_INFO: `/v3/users/969c049b9b8744cbb670b7eb62c05e80` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:20.491879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=969c049b9b8744cbb670b7eb62c05e80)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:20.493800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:20.509172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:20.718355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969c049b9b8744cbb670b7eb62c05e80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.719011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969c049b9b8744cbb670b7eb62c05e80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.730470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969c049b9b8744cbb670b7eb62c05e80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.815719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969c049b9b8744cbb670b7eb62c05e80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.823979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969c049b9b8744cbb670b7eb62c05e80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.830538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1212/2421] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:20 2022] DELETE /identity/v3/users/969c049b9b8744cbb670b7eb62c05e80 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:20.835111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:20.835608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:20.835707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:20.860784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:20.860784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:20.866574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:20.920622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1210/2422] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:20.931450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:20.933157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:20.993249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9e02-c2af-4946-a2f3-7c7de650ea08 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:20.996802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:20.997405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:20.997680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:20.997971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:21.007938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:21.009351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7c59-6dbc-4467-91ad-d997c21cba93 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:21.018833 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1213/2423] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:21.533134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:21.533134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:21.554334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62c5c-dc41-4932-91fb-9e630a16b3cd None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:21.561506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:21.561506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:21.561506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:21.561506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] PATH_INFO: `/v3/projects/ba5180b2618e47c1b7fe250b0492e6dd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:21.562686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5180b2618e47c1b7fe250b0492e6dd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:21.565086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:21.714158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5180b2618e47c1b7fe250b0492e6dd', 'request_id': 'req-318221cf-499a-452c-84d1-3722d8e8871e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.720317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5180b2618e47c1b7fe250b0492e6dd', 'request_id': 'req-318221cf-499a-452c-84d1-3722d8e8871e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.813513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5180b2618e47c1b7fe250b0492e6dd', 'request_id': 'req-318221cf-499a-452c-84d1-3722d8e8871e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.825883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] The token cache is being invalidate because project ba5180b2618e47c1b7fe250b0492e6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:21.826169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.826799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-318221cf-499a-452c-84d1-3722d8e8871e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.828585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1211/2424] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:21 2022] DELETE /identity/v3/projects/ba5180b2618e47c1b7fe250b0492e6dd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:27.352035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa43-23b4-4d9a-b150-f904f1c15759 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.352472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa43-23b4-4d9a-b150-f904f1c15759 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.352621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa43-23b4-4d9a-b150-f904f1c15759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.372340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a6edaa43-23b4-4d9a-b150-f904f1c15759 None None] MFA Rules not processed for user `b51ab52dfba64392ad65d894c6dadb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:27.373546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a6edaa43-23b4-4d9a-b150-f904f1c15759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:27.434351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1214/2425] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:31.822058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:33.270720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa53b1-9ec5-44de-b1a1-4f0726b67be1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:33.273374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa53b1-9ec5-44de-b1a1-4f0726b67be1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:33.273374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa53b1-9ec5-44de-b1a1-4f0726b67be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:33.294037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-96fa53b1-9ec5-44de-b1a1-4f0726b67be1 None None] MFA Rules not processed for user `d55c162e5e13490aaaf8e94951a55c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:33.295719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-96fa53b1-9ec5-44de-b1a1-4f0726b67be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:33.364135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1212/2426] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:37.426283 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=72,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:38.727383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:38.728004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:38.728004 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:38.747396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] MFA Rules not processed for user `caa000b3f2f242a7a1418c3a56bdc55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:38.748643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:38.803307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1215/2427] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:43.356983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=25 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:48.796650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=25 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:53.823971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363995-bca6-475b-be3c-33024ec5822d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:53.824526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363995-bca6-475b-be3c-33024ec5822d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:53.824849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363995-bca6-475b-be3c-33024ec5822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:53.847135 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f2363995-bca6-475b-be3c-33024ec5822d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:53.848800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f2363995-bca6-475b-be3c-33024ec5822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:53.919047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1213/2428] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:53.935761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:53.937340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:54.022731 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af28c2-ba58-4508-98a5-1eda01175e0e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:54.029115 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:54.029936 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:54.030403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:54.030864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:54.040221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:54.041822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:54.052021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1216/2429] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:57.336010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce1ac-0a12-410a-a28d-f08b7245ed5a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:57.336520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce1ac-0a12-410a-a28d-f08b7245ed5a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:57.336619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce1ac-0a12-410a-a28d-f08b7245ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:57.356271 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-14bce1ac-0a12-410a-a28d-f08b7245ed5a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:57.357937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-14bce1ac-0a12-410a-a28d-f08b7245ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:57.365685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1214/2430] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:57.383340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:57.384739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:57.399200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5cdb-ebc4-4f21-8820-7731f60f7ef3 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:57.404797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:57.405408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:57.405682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:57.405948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:57.416186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:57.417826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:57.427776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1217/2431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:00.395945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1ac9c-b75c-4312-9f21-4fa2a6ef5aaa None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:00.396503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1ac9c-b75c-4312-9f21-4fa2a6ef5aaa None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:00.396503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1ac9c-b75c-4312-9f21-4fa2a6ef5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:00.417822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c8b1ac9c-b75c-4312-9f21-4fa2a6ef5aaa None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:00.419018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c8b1ac9c-b75c-4312-9f21-4fa2a6ef5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:00.426819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1215/2432] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:00.445845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:00.457600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a44af-2256-4fef-ac27-9091573426f4 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:00.463620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:00.464255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:00.464533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:00.464836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:00.473060 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:00.474625 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:00.484935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1218/2433] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:03.595837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266f86-e0a6-4100-830f-8a84f4c8d488 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.596313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266f86-e0a6-4100-830f-8a84f4c8d488 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.596463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266f86-e0a6-4100-830f-8a84f4c8d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.616773 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-58266f86-e0a6-4100-830f-8a84f4c8d488 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:03.618136 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-58266f86-e0a6-4100-830f-8a84f4c8d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:03.625897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1216/2434] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:03.642476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:03.654482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738d36-e3a5-4d4a-a47c-69788e759e79 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:03.660280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:03.660901 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:03.661178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:03.661447 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:03.670162 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:03.671733 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:03.682029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1219/2435] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:06.855568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614ca0-6aac-4d98-bc63-9fcdb7745226 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.856092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614ca0-6aac-4d98-bc63-9fcdb7745226 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.856194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614ca0-6aac-4d98-bc63-9fcdb7745226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.875994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f9614ca0-6aac-4d98-bc63-9fcdb7745226 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:06.877178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f9614ca0-6aac-4d98-bc63-9fcdb7745226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:06.885768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1217/2436] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Aug 24 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:06.901560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:06.912924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbda3d3-a4a3-4626-9681-1fbe56026d0e service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:06.919062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:06.919773 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:06.920088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:06.920360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:06.928596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:06.931006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:06.940452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1220/2437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:16.871279 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=39 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:16.936157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=58 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:32.742409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:32.744371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:32.744371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:32.766719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] MFA Rules not processed for user `7e35335d035c44daaf79627c255e9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:32.767984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:32.827148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1218/2438] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:38.312076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.314263 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:38.422215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5743-a5db-4854-9d2a-29f63c98f6ee service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.426486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.427096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.427416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.427732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.429532 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:38.445795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.447297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.459487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1221/2439] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:40.190040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:40.204417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d909e03-10e0-4903-a3ff-24661ffeaeff None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:40.209201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:40.210074 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:40.210555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:40.210975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:40.213541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:40.227277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:40.229797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:40.239438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1219/2440] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:42.694765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:42.696527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:42.711249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d19fa-1b18-4a76-8ff8-d3f5f21b6c68 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:42.716071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:42.716465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:42.716913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:42.717188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:42.719501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:42.739261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:42.740871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:42.752539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1222/2441] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:43.269485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:43.282976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02c760-adb9-4276-b159-402e186114c5 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:43.288740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:43.289332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.289601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.289864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:43.291980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:43.303027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:43.304649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:43.315286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1220/2442] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:43.948225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:43.973053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48fb-3997-4ff0-8121-c814931fd8ea service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:43.994749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:43.995516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.995904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.003956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.003956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.012488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.014742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b84e56-2089-4578-b6bd-faecd1027805 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.028739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1223/2443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:44.318017 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:44.320068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.345893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacd11-bd1e-4400-b65c-b9afb3fc13d9 service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:44.353946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:44.354880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.355470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.356047 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] PATH_INFO: `/v3/users/d55c162e5e13490aaaf8e94951a55c09` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.357386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55c162e5e13490aaaf8e94951a55c09)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.363508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.474249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201f393-f699-4048-95c8-e9f221577359 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.474642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201f393-f699-4048-95c8-e9f221577359 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.474903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201f393-f699-4048-95c8-e9f221577359 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.476617 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1224/2444] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:45:44.485660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.486131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.486441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.507071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] MFA Rules not processed for user `34849cc7b860429287542bb4bd34a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:44.508345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.577572 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1225/2445] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:44.587142 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55c162e5e13490aaaf8e94951a55c09'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.587919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55c162e5e13490aaaf8e94951a55c09'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.588855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:44.590229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.595115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55c162e5e13490aaaf8e94951a55c09'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.602892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62eb7e-6efd-4a92-8b12-a72b8353870c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:44.608694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:44.609360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.609644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.610076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.611932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.624085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.625663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.638245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1226/2446] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:44.656338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:44.658196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.673584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd681-7e9a-44fe-9d94-fb787d9d8a06 service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:44.679534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:44.680295 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.680661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.680995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] PATH_INFO: `/v3/users/b51ab52dfba64392ad65d894c6dadb5a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.682824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51ab52dfba64392ad65d894c6dadb5a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.685165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.685863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55c162e5e13490aaaf8e94951a55c09'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.702246 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55c162e5e13490aaaf8e94951a55c09'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.713482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1221/2447] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:44 2022] DELETE /identity/v3/users/d55c162e5e13490aaaf8e94951a55c09 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:44.871551 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51ab52dfba64392ad65d894c6dadb5a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.872446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51ab52dfba64392ad65d894c6dadb5a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.877889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:44.884974 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51ab52dfba64392ad65d894c6dadb5a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.971440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51ab52dfba64392ad65d894c6dadb5a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.979489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:44.981062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51ab52dfba64392ad65d894c6dadb5a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.981492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.993233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1227/2448] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:44 2022] DELETE /identity/v3/users/b51ab52dfba64392ad65d894c6dadb5a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:45.042145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:45.056785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98466-abcd-4e58-9eee-c8edad976e46 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.113311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.113971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.114240 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.114507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] PATH_INFO: `/v3/projects/25fd64c5f3c348579ecfa06d6ddb986e` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.115611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fd64c5f3c348579ecfa06d6ddb986e)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.117530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.223264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fd64c5f3c348579ecfa06d6ddb986e', 'request_id': 'req-ff3ded7f-7a69-4171-9f39-bd1977820826'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.229621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fd64c5f3c348579ecfa06d6ddb986e', 'request_id': 'req-ff3ded7f-7a69-4171-9f39-bd1977820826'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.241965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:45.245756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:45.257327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de662a-ac71-48be-9494-1c51e64a2900 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.317419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.318182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.318460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.318737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] PATH_INFO: `/v3/projects/061f034f4888456fa9377affd9cb5ca1` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.319911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061f034f4888456fa9377affd9cb5ca1)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.322364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.339671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fd64c5f3c348579ecfa06d6ddb986e', 'request_id': 'req-ff3ded7f-7a69-4171-9f39-bd1977820826'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.351847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] The token cache is being invalidate because project 25fd64c5f3c348579ecfa06d6ddb986e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:45.352283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.352903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ff3ded7f-7a69-4171-9f39-bd1977820826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.354489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1222/2449] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:44 2022] DELETE /identity/v3/projects/25fd64c5f3c348579ecfa06d6ddb986e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:45.500433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061f034f4888456fa9377affd9cb5ca1', 'request_id': 'req-1326f7d8-35b0-4191-afb4-059855757c08'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.591038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061f034f4888456fa9377affd9cb5ca1', 'request_id': 'req-1326f7d8-35b0-4191-afb4-059855757c08'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.598405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061f034f4888456fa9377affd9cb5ca1', 'request_id': 'req-1326f7d8-35b0-4191-afb4-059855757c08'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.610585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] The token cache is being invalidate because project 061f034f4888456fa9377affd9cb5ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:45.610818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.611488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1326f7d8-35b0-4191-afb4-059855757c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:45.613315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1228/2450] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:45 2022] DELETE /identity/v3/projects/061f034f4888456fa9377affd9cb5ca1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:45.618634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.618926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.619211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.639670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:45.640940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:45.708624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1223/2451] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:45.723245 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.723525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.723814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.744187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:45.745386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:45.753277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1229/2452] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:45.757732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:45.767586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8fe9-332f-4b53-940b-666217e68953 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.772262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.772856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.773137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.773402 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.774036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:45.774334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.777109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.789326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1224/2453] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:45.800086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:45.809677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c7d4-cc4c-4489-aed4-74b945420e73 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.814997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.815601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.816093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.816368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.817008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.818902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.994912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1230/2454] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:45 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:45.999410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:46.012086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e3fd1-4ea2-416b-b94d-beb7c3316a9c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:46.028140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:46.073817 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036135-2648-4037-a45a-707573c567ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:46.074423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036135-2648-4037-a45a-707573c567ab admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.074701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036135-2648-4037-a45a-707573c567ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.074970 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036135-2648-4037-a45a-707573c567ab admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.075597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27036135-2648-4037-a45a-707573c567ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:46.077861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27036135-2648-4037-a45a-707573c567ab admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:46.195249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1225/2455] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:45 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:46.200014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:46.210789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fa9c-5f45-4d42-adfa-7af7c8127f3d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:46.216606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:46.217212 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.217484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.217747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.218564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:46.220516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:46.234735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1231/2456] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:46.235629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036135-2648-4037-a45a-707573c567ab admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:46.246776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036135-2648-4037-a45a-707573c567ab admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:46.252076 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:46.252697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.252997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.253262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.253906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:46.255496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162c3f0-89a0-4597-86fe-159266e85efe admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:46.269137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1226/2457] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:46.273306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:46.284068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9d27c-3911-4751-a21d-aa0f7a210923 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:46.299701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:46.299701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.299701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.299701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] PATH_INFO: `/v3/projects/8e8ed1e2c0124f90adfed9f4c13c7755/users/5d9672843107418cab4f0a1be39593c7/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.314040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8ed1e2c0124f90adfed9f4c13c7755, user_id=5d9672843107418cab4f0a1be39593c7, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:46.316995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:46.401381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:46.407170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1232/2458] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:46 2022] PUT /identity/v3/projects/8e8ed1e2c0124f90adfed9f4c13c7755/users/5d9672843107418cab4f0a1be39593c7/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:46.412389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3f36a-9ac5-4070-83bc-44213a3c0ce4 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.412867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3f36a-9ac5-4070-83bc-44213a3c0ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.412962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3f36a-9ac5-4070-83bc-44213a3c0ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.432890 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c0b3f36a-9ac5-4070-83bc-44213a3c0ce4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:46.434080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c0b3f36a-9ac5-4070-83bc-44213a3c0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:46.498962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1227/2459] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:46.508540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:46.510908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:46.567282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22883b-6eef-48f8-8783-1c993459d163 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:46.570887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:46.571478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:46.571754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:46.572055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:46.581429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:46.582874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:46.593346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1233/2460] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:52.841371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b44e76-52fb-411b-8af8-63212a5ac475 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:52.841907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b44e76-52fb-411b-8af8-63212a5ac475 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:52.842044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b44e76-52fb-411b-8af8-63212a5ac475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:52.877275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-59b44e76-52fb-411b-8af8-63212a5ac475 None None] MFA Rules not processed for user `5d9672843107418cab4f0a1be39593c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:52.878538 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-59b44e76-52fb-411b-8af8-63212a5ac475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:52.953606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1228/2461] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:52.968383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:52.977475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:53.057429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428759de-9fed-403f-8ae4-d3726c8ecd91 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:53.063422 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:53.064217 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:53.064504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:53.064774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:53.080016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:53.082014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:53.104129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1234/2462] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:53.473777 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ce00b-1311-4a9c-a90f-d798091f243c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:53.474063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ce00b-1311-4a9c-a90f-d798091f243c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:53.474335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ce00b-1311-4a9c-a90f-d798091f243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:53.496386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-220ce00b-1311-4a9c-a90f-d798091f243c None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:53.497655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-220ce00b-1311-4a9c-a90f-d798091f243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:53.529853 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:53.572013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1229/2463] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:53.745836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:53.747652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:53.839439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ef59-8bdc-4860-bd16-d16e9affdcdc service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:53.844860 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:53.845477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:53.845775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:53.846042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:53.860966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:53.860966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:53.879995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1235/2464] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:45:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:45:56.052850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.054481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.054988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.096917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] MFA Rules not processed for user `5d9672843107418cab4f0a1be39593c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:56.098542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:56.108491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1230/2465] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:45:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:56.494022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.510907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2f9-a759-4010-b67d-b534205c1a41 service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.514951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.515906 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.516235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.516686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.518657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:56.533694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.535136 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.546747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1236/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:57.378220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:57.380345 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:57.487215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6cb3-7d2e-4a20-9946-98ed2664f64d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:57.495285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:57.495954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:57.496236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:57.496509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:57.499103 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:57.516966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:57.518406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:57.529936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1231/2467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:01.473186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:01.477404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:01.483168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056440-d9c1-4e38-b3bb-b79fbe2171d5 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:01.492354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:01.492354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:01.492354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:01.493929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:01.505175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:01.518475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:01.520922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caccdcd-4d8f-4b01-83bc-49dcb5f273e3 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:01.530304 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1237/2468] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:02.464189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:02.466385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.485619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3bf9c-8d89-49f9-b2c5-6887bd8453c5 service placement] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:02.492559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:02.494029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:02.494483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:02.494874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:02.497186 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:02.517607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:02.519544 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:02.547842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1232/2469] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:11.539440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:12.528612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=55 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:14.226027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b657-23cb-40d4-9a08-5f01d07dcd53 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.226524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b657-23cb-40d4-9a08-5f01d07dcd53 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.226640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b657-23cb-40d4-9a08-5f01d07dcd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:14.246715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1809b657-23cb-40d4-9a08-5f01d07dcd53 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:14.247941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1809b657-23cb-40d4-9a08-5f01d07dcd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.254958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1238/2470] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:14.267634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:14.279288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddea35e-dbf9-4633-aec1-ee997ba45d20 service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:14.284308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:14.284891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.285166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.285430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:14.294061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:14.295638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a9084-1c9c-46d6-ac32-8c3bcaa501f5 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:14.303986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1233/2471] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:24.241485 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:24.300447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=6 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:29.697478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68c09-b4dd-476d-8f4a-2929c3d7df78 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.698046 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68c09-b4dd-476d-8f4a-2929c3d7df78 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.698197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b68c09-b4dd-476d-8f4a-2929c3d7df78 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.699769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1239/2472] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:46:29.705989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f8e-126c-4508-8942-8e3d7a8b7f0b None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.706814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f8e-126c-4508-8942-8e3d7a8b7f0b None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.707092 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f8e-126c-4508-8942-8e3d7a8b7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.728746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-32514f8e-126c-4508-8942-8e3d7a8b7f0b None None] MFA Rules not processed for user `5d03ed0ea7f443bf881a38c217f716e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:29.730467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-32514f8e-126c-4508-8942-8e3d7a8b7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.737580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1234/2473] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:29.768309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b68c09-b4dd-476d-8f4a-2929c3d7df78 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:29.784850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b68c09-b4dd-476d-8f4a-2929c3d7df78 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:29.790048 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:29.791199 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.792017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.792908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.803134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:29.804845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8268b2e-26ba-45d4-b4b2-851469b1e653 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:29.814114 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1240/2474] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:29.900862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610480-c049-424b-a626-cd5de19f44f9 None None] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.901195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610480-c049-424b-a626-cd5de19f44f9 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.901568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610480-c049-424b-a626-cd5de19f44f9 None None] PATH_INFO: `/` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.903129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1235/2475] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 24 10:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:46:29.908897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.909232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.909508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.932447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef610480-c049-424b-a626-cd5de19f44f9 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:29.935627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] MFA Rules not processed for user `1b0807da1ad345eb9de13973cae6bfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:29.937037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.947776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1241/2476] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 24 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:29.955238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef610480-c049-424b-a626-cd5de19f44f9 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:29.961552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:29.964681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.964791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:29.964936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.964936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.965171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:29.973627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb97ca-c571-4dae-954c-edc3509ea490 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:29.978348 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:29.980636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:29.980794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a371b0e-fbf1-4865-b420-2ab61b756cbf service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:29.981717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:29.982198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:29.982710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:29.998307 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:29.999837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:30.000486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1236/2477] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:30.031430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1242/2478] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:31.831026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:31.831514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:31.831651 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:31.850692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:31.851925 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:31.859656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1237/2479] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:31.873708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:31.884765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afbbe-88f6-46e5-8c95-fd542442f270 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:31.889856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:31.890442 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:31.890715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:31.890982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:31.899047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:31.900737 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:31.909548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1243/2480] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:41.846311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=12 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:41.906017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=21 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:45.114044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:45.123396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b795fd-cdb9-4214-a655-1936f6fe5f9e None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:45.126861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:45.127442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:45.127716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:45.128011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:45.129698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:45.142148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:45.143579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:45.154129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1238/2481] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:48.606863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.619145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f15e6-5712-4c3e-aeaf-58c87f6c3fbf service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.624453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.625055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.625346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.625668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.627887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:48.640367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.641961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.653193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1244/2482] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:48.742861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:48.744400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:48.756993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950b41-18c3-4e07-8bee-351f4d19dda6 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:48.763554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:48.764360 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:48.764635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:48.764900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] PATH_INFO: `/v3/users/7e35335d035c44daaf79627c255e9278` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:48.766018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e35335d035c44daaf79627c255e9278)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:48.767984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:48.922878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e35335d035c44daaf79627c255e9278'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.923521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e35335d035c44daaf79627c255e9278'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.930456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e35335d035c44daaf79627c255e9278'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.984011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e35335d035c44daaf79627c255e9278'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:48.996680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-1d23fac9-935a-4732-9f78-b2aabc48d51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e35335d035c44daaf79627c255e9278'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.002566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1239/2483] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:48 2022] DELETE /identity/v3/users/7e35335d035c44daaf79627c255e9278 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:49.221370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.235022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7376-ca7a-481f-ab29-d55605cf88a3 service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.302448 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.303085 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.303366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.303639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] PATH_INFO: `/v3/projects/2a4111b3b43247669bd40f0acd6caee2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.304808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4111b3b43247669bd40f0acd6caee2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.306764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.443540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4111b3b43247669bd40f0acd6caee2', 'request_id': 'req-589eb009-d190-4623-8854-96722e2af3dd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.509981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4111b3b43247669bd40f0acd6caee2', 'request_id': 'req-589eb009-d190-4623-8854-96722e2af3dd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.518102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4111b3b43247669bd40f0acd6caee2', 'request_id': 'req-589eb009-d190-4623-8854-96722e2af3dd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.531016 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] The token cache is being invalidate because project 2a4111b3b43247669bd40f0acd6caee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:49.531462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.532155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-589eb009-d190-4623-8854-96722e2af3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:49.533709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1245/2484] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:49 2022] DELETE /identity/v3/projects/2a4111b3b43247669bd40f0acd6caee2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:49.538843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.539223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.539609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.560205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:49.561523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:49.625229 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1240/2485] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:49.632994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.633490 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.633591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.655845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:49.658334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:49.668822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1246/2486] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:49.672997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.683309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e825225-8d6a-4b54-9695-d6b1e9b038b1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.687840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.688432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.688706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.688973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.689604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:49.689898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.691473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.703431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1241/2487] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:46:49.707727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.717491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774fd7-4865-4865-9f73-1dfaa686bc92 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.722161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.722788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.723068 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.723342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.724038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.725937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.819631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1247/2488] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:49.824043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:49.834437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9d35c-438e-411c-a121-4e99abd36194 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:49.880585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:49.893286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:49.893885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:49.894164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:49.894432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:49.895049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:49.897099 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:49.989364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1242/2489] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:49 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:49.993431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.003984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b815850-c49a-421a-8426-356e96fc92eb admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.009408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.010010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.010430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.010700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.011539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.013222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.023117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1248/2490] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:50.036082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.046829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a747d-fe94-4080-9ed9-204ef29c6b2c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.051486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.052108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.052390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.052659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.053315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.054875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b6821-fc57-46e8-9a66-4eb88654cde4 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.064869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1243/2491] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:50.068940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.079356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9792c9-39dc-4fb7-b7b2-d253ffc9aca4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.084989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.085624 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.085897 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.086163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] PATH_INFO: `/v3/projects/d346ab35dd5f425c9ccec0a966f4a44f/users/ff6c8d67266d440bb4740e69fbcc83fc/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.101857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d346ab35dd5f425c9ccec0a966f4a44f, user_id=ff6c8d67266d440bb4740e69fbcc83fc, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.105278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.181255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1249/2492] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:50 2022] PUT /identity/v3/projects/d346ab35dd5f425c9ccec0a966f4a44f/users/ff6c8d67266d440bb4740e69fbcc83fc/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:50.191405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.191681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.191980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.219770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] MFA Rules not processed for user `ff6c8d67266d440bb4740e69fbcc83fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:50.220978 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:50.285079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1244/2493] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:50.296479 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:50.298268 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:50.312885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:50.374041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d9f0-146c-4a04-a365-17305f698cb6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:50.379484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:50.381333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:50.381333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:50.381333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:50.389130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:50.390725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e567a-b67b-4d39-8f8b-64b850a5ede0 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:50.399926 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1250/2494] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:56.501175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.563676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664892-169e-4ba5-9dfc-69babb4af284 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.568396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.569019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.569299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.569569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] PATH_INFO: `/v3/users/ff6c8d67266d440bb4740e69fbcc83fc` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.570847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6c8d67266d440bb4740e69fbcc83fc)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.572878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.717247 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6c8d67266d440bb4740e69fbcc83fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.717892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6c8d67266d440bb4740e69fbcc83fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.724584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6c8d67266d440bb4740e69fbcc83fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.726208 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:56.792967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6c8d67266d440bb4740e69fbcc83fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.805593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6c8d67266d440bb4740e69fbcc83fc'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:56.811387 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1245/2495] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:56 2022] DELETE /identity/v3/users/ff6c8d67266d440bb4740e69fbcc83fc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:56.817582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.818099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.818099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.837364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:56.839210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.897450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1251/2496] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:56.907967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:56.909347 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.966150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667c28-db60-4eca-ad37-b8faa4035b23 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:56.969869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:56.970411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.970692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.970964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.980343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:56.981772 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361119e8-c4d7-4bca-8e9f-51befa25a284 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:56.991171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1246/2497] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:57.399871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.399871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.412075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed5e5-73e2-46b3-8400-102773a3cf74 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.417292 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:57.417932 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.418235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.418531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] PATH_INFO: `/v3/projects/d346ab35dd5f425c9ccec0a966f4a44f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.419663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d346ab35dd5f425c9ccec0a966f4a44f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:57.421598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:57.567328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd346ab35dd5f425c9ccec0a966f4a44f', 'request_id': 'req-c12fd1fb-b13e-47dd-b791-4f57c6644799'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.635847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd346ab35dd5f425c9ccec0a966f4a44f', 'request_id': 'req-c12fd1fb-b13e-47dd-b791-4f57c6644799'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.642557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd346ab35dd5f425c9ccec0a966f4a44f', 'request_id': 'req-c12fd1fb-b13e-47dd-b791-4f57c6644799'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.653752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] The token cache is being invalidate because project d346ab35dd5f425c9ccec0a966f4a44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:57.654040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.654675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c12fd1fb-b13e-47dd-b791-4f57c6644799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:57.656286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1252/2498] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:57 2022] DELETE /identity/v3/projects/d346ab35dd5f425c9ccec0a966f4a44f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:57.661312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.661804 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.661914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.681976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:57.683198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.742922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1247/2499] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:57.752158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.752445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.752720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.773206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:57.774347 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.783040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1253/2500] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:57.787328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.797616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2cf6-6c90-448b-a062-49b1935dfd32 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.802119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:57.802701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.802980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.803242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.803898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:57.804195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:57.805767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:57.817693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1248/2501] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:57.821880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.831381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f316ac-63b0-4713-ad06-f85eeff35ad1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.836322 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:57.836921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.837201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.837472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.838179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:57.840427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:57.855868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:57.927792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1254/2502] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:57 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:57.932197 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.942616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066cb-2798-45bb-91ed-a82253a82eab admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.999907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.000506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.000781 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.001049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.001674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.003612 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.013420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:58.092585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1249/2503] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:57 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:58.096752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.108207 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befadd8-2aea-4a0a-baa3-b903ada65cd9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.112835 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.113431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.113712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.113980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.114610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.116225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.126857 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1255/2504] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:58.130807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.141257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed862-20b3-49de-8ce2-51acdcb72c31 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.146036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.146622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.146901 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.147174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.147837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.149444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e84800-42b9-492a-b36b-41ae883e468d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.161277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1250/2505] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:58.165356 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.175704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a503-3e82-4483-b413-5d975f209f90 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.180224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.180853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.181127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.181395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] PATH_INFO: `/v3/projects/24792d0eef464aa48088a5b4363585c7/users/f848e5e5fd854469ae5ff1f22a41d197/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.195340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24792d0eef464aa48088a5b4363585c7, user_id=f848e5e5fd854469ae5ff1f22a41d197, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.197980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.272399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1256/2506] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:58 2022] PUT /identity/v3/projects/24792d0eef464aa48088a5b4363585c7/users/f848e5e5fd854469ae5ff1f22a41d197/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:58.283281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.283566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.283885 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.315029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] MFA Rules not processed for user `f848e5e5fd854469ae5ff1f22a41d197`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:58.316277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.380490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1251/2507] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:58.392069 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:58.393742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:58.453070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6bf30-7256-4919-aaa0-20bf2c10cea0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:58.456868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:58.457478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:58.457758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:58.458028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:58.466908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:58.468378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc2fcf-8d29-4464-8748-f803c4f7edce service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:58.477650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1257/2508] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:08.377571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:08.379433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:08.443490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117446-06e7-426b-b0ac-953af95c2ad0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:08.448307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:08.449592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.449873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.450140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] PATH_INFO: `/v3/users/f848e5e5fd854469ae5ff1f22a41d197` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.451537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f848e5e5fd854469ae5ff1f22a41d197)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:08.453537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.473246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:08.649219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f848e5e5fd854469ae5ff1f22a41d197'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.649805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f848e5e5fd854469ae5ff1f22a41d197'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.657456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f848e5e5fd854469ae5ff1f22a41d197'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.729365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f848e5e5fd854469ae5ff1f22a41d197'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.741776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f848e5e5fd854469ae5ff1f22a41d197'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:08.748253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1252/2509] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:08 2022] DELETE /identity/v3/users/f848e5e5fd854469ae5ff1f22a41d197 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:08.752738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.753022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.753293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.772626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:08.773818 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.831667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1258/2510] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:08.841524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:08.843064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:08.899748 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81824034-db1b-4c04-9589-f5ce4a5e52cf admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:08.903955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:08.904554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:08.904828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:08.905095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:08.913837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:08.915258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a5059-da4a-4759-8f85-7d7ae0e5ab49 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:08.925207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1253/2511] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:09.326761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.328312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.340605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3c22-d3d1-4fe6-9d64-c869c24691af None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.346391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.347024 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.347300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.347567 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] PATH_INFO: `/v3/projects/24792d0eef464aa48088a5b4363585c7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.348719 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=24792d0eef464aa48088a5b4363585c7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.350619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.502222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24792d0eef464aa48088a5b4363585c7', 'request_id': 'req-31b7379b-7e12-46af-a244-90fb23f28dbe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.572087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24792d0eef464aa48088a5b4363585c7', 'request_id': 'req-31b7379b-7e12-46af-a244-90fb23f28dbe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.579864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24792d0eef464aa48088a5b4363585c7', 'request_id': 'req-31b7379b-7e12-46af-a244-90fb23f28dbe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.591525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] The token cache is being invalidate because project 24792d0eef464aa48088a5b4363585c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:09.591840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.592509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-31b7379b-7e12-46af-a244-90fb23f28dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:09.594076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1259/2512] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:09 2022] DELETE /identity/v3/projects/24792d0eef464aa48088a5b4363585c7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:09.599124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.601429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.601429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.622873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:09.624129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.642513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:09.693619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1254/2513] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:09.695376 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.695724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.696104 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.718111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:09.719351 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:09.727403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1260/2514] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:09.731637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.741237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d936f7-338a-478b-b735-e69a8b566ef8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.745796 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.746419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.746700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.746968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.747626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:09.747958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.749553 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.760835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1255/2515] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:09.765749 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.774953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a9da4-bce6-4d19-afe4-59dc1380dd22 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.780506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.781106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.781384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.781656 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.782287 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.784214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:09.874470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1261/2516] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:09.878670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:09.889150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd182-d7f9-4de2-9cfc-0dfc40fd1f78 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:09.945622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:09.946140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:09.946416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:09.946683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:09.947288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:09.950253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.053033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1256/2517] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:09 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:10.057312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.068435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa64d5-4f1d-47f6-8047-e4e02fdcbf40 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.073383 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.074742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.075051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.075693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.076409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.078005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.088628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1262/2518] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:10.093613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.105452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d9aa-b0fe-42ee-b193-40bf073a8e87 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.111683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.111683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.111683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.111683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.112108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.113407 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957043-6b37-49e9-a2ff-2ed1800a3705 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.124864 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1257/2519] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:10.129206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.140032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e82b-a66d-4f12-9324-d8ef2def825f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.144791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.145450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.145729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.146003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] PATH_INFO: `/v3/projects/711849ed41b247a0ad035c85bbdc9514/users/fabadcdaf990421c9b26f94b1ac3091f/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.161721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] RBAC: Authorizing `identity:create_grant(project_id=711849ed41b247a0ad035c85bbdc9514, user_id=fabadcdaf990421c9b26f94b1ac3091f, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.164433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.259099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1263/2520] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:10 2022] PUT /identity/v3/projects/711849ed41b247a0ad035c85bbdc9514/users/fabadcdaf990421c9b26f94b1ac3091f/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:10.260731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.261061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.261396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.292900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] MFA Rules not processed for user `fabadcdaf990421c9b26f94b1ac3091f`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:10.294338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:10.383823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1258/2521] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:10.401221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.425134 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:10.468005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4569d-0765-40af-a20c-68e226cb202c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.473093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.474751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.474751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.474751 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.487610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.487610 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.600938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1264/2522] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:10.605740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.617172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e445a-8af9-48a3-9d2e-f9f056855704 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.638929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:10.685851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.686462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.686741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.687012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.687690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.689643 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.776300 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1259/2523] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:10.780780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.791487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266e16a-b573-4b32-845a-4c809946bce9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.798247 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.799008 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.799290 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.799637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.800291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.802109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.818434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1265/2524] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:10.819742 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.830490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1aab-40e2-42a9-b5e4-94d9b134ea28 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.835325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.836031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.836409 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.836731 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.837316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.838959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de557d56-80cc-4d3d-9a4a-ef05a281a908 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.850710 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1260/2525] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:10.854674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:10.865443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53278a79-9186-4ea0-afc7-6700dc73c1ef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:10.870133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:10.870852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.871130 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.871503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] PATH_INFO: `/v3/projects/8e0500a60f314e709fb18fb0c2b92061/users/b7c51e4ee0d74f58a85e9e14754ba906/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:10.891930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0500a60f314e709fb18fb0c2b92061, user_id=b7c51e4ee0d74f58a85e9e14754ba906, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:10.894816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:10.970827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1266/2526] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:10 2022] PUT /identity/v3/projects/8e0500a60f314e709fb18fb0c2b92061/users/b7c51e4ee0d74f58a85e9e14754ba906/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:10.981852 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:10.982145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:10.982420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.018922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] MFA Rules not processed for user `b7c51e4ee0d74f58a85e9e14754ba906`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.020196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.106213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1261/2527] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:11.110996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.189823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aebae-80d3-4a55-9486-0165fae23b05 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.194789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.195399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.195672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.195971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.196650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.198584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.306846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1267/2528] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:11.308936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.328243 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449433c-7f79-4350-998d-11dc960609d8 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.392113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.392721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.392998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.393266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.393887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.395818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.488289 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1262/2529] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:11.492297 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.512348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7287-6c78-4f9b-9f58-a4541156b7d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.517934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.518717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.519636 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.520087 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.521082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.523620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.542725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1268/2530] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:11.544035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.561935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6615-9471-4be7-8274-1b9ccb601285 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.573449 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.575214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.575746 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.576178 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] PATH_INFO: `/v3/projects/1ab3df0a92b04c69992b5f109791288a/users/b61f44c6cac349abb6c16bf2c39dd572/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.598195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:11.601693 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab3df0a92b04c69992b5f109791288a, user_id=b61f44c6cac349abb6c16bf2c39dd572, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.604600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.730611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1263/2531] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:11 2022] PUT /identity/v3/projects/1ab3df0a92b04c69992b5f109791288a/users/b61f44c6cac349abb6c16bf2c39dd572/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:11.734811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.745128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833210e7-6feb-43da-856e-7d0c39068714 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.794774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:11.811630 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.812425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.812709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.812985 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.813767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.815454 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59c269-d36e-4816-ab62-63d1c2a68519 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.828817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1269/2532] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:11.834675 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:11.845363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b21bd-8443-46a1-a31f-c5e9b898172c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:11.850021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:11.850664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.850937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.851205 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] PATH_INFO: `/v3/projects/1ab3df0a92b04c69992b5f109791288a/users/b61f44c6cac349abb6c16bf2c39dd572/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.853217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab3df0a92b04c69992b5f109791288a, user_id=b61f44c6cac349abb6c16bf2c39dd572, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:11.856057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:11.866882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1264/2533] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:11 2022] PUT /identity/v3/projects/1ab3df0a92b04c69992b5f109791288a/users/b61f44c6cac349abb6c16bf2c39dd572/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:11.877716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:11.878005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:11.878316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:11.908981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] MFA Rules not processed for user `b61f44c6cac349abb6c16bf2c39dd572`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:11.910225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:11.988935 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1270/2534] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:12.000921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:12.002623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:12.067122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f28d4-f9a1-4377-bf85-3d3eb49987a8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:12.071440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:12.072079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:12.072357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:12.072624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:12.082703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:12.084182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:12.093884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1265/2535] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:13.183770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.193361 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58c20-a8a3-4727-8c38-df0aa3d6b729 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.198740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.198740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.198740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.198740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.258899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.260371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.270083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1271/2536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:15.783474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.785051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.844545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abe2f-64b2-4868-b79e-cba5ef63377a service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.848174 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.848907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.849190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.849458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.851193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.925184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.926649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.937160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1266/2537] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:18.304829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.306420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.320218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7353ab-47b0-46b5-b3ba-55040714e45b service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.325044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.325955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.326236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.330522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.395355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.396848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.405997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1272/2538] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:19.793963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:19.795463 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:19.809529 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24acce-7107-45a3-9396-fff050f94679 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:19.814483 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:19.815153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:19.815431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:19.815705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] PATH_INFO: `/v3/users/caa000b3f2f242a7a1418c3a56bdc55c` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:19.816959 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa000b3f2f242a7a1418c3a56bdc55c)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:19.819028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:19.936445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:20.026301 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa000b3f2f242a7a1418c3a56bdc55c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.026770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa000b3f2f242a7a1418c3a56bdc55c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.033983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa000b3f2f242a7a1418c3a56bdc55c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.126621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa000b3f2f242a7a1418c3a56bdc55c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.139091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-76857887-4952-4831-9f1a-0309caac3bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa000b3f2f242a7a1418c3a56bdc55c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.144963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1267/2539] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:19 2022] DELETE /identity/v3/users/caa000b3f2f242a7a1418c3a56bdc55c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:20.425647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.431847 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:20.438469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806793a-120d-4f0b-a02e-ecd084f4ca21 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:20.498289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:20.499386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.499942 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.500492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] PATH_INFO: `/v3/projects/2e1369d542a94886b52b2ebe43d2e3a5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.502525 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1369d542a94886b52b2ebe43d2e3a5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:20.505648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:20.624382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1369d542a94886b52b2ebe43d2e3a5', 'request_id': 'req-15a057c9-db2d-410b-a416-d3d0ff5f9848'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.697254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1369d542a94886b52b2ebe43d2e3a5', 'request_id': 'req-15a057c9-db2d-410b-a416-d3d0ff5f9848'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.704631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1369d542a94886b52b2ebe43d2e3a5', 'request_id': 'req-15a057c9-db2d-410b-a416-d3d0ff5f9848'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.716229 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] The token cache is being invalidate because project 2e1369d542a94886b52b2ebe43d2e3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:20.716520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.717174 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15a057c9-db2d-410b-a416-d3d0ff5f9848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:20.718678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1273/2540] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:20 2022] DELETE /identity/v3/projects/2e1369d542a94886b52b2ebe43d2e3a5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:20.723646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.723964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.724241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.744191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:20.746033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:20.804756 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1268/2541] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:20.813962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.814373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.814730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.835278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:20.836507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:20.844506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1274/2542] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:20.848830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.858634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8c1e9-b231-4ce9-8b48-fd39dfe93419 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:20.863210 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:20.863827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.864108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.864378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.865013 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:20.865313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:20.866903 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:20.878939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1269/2543] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:20.883506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.893345 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa88ce-02b0-4f30-aafa-0dc8527fbbfd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:20.898030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:20.903899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.903899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.903899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.903899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:20.903899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:20.978908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1275/2544] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:20.983688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.993658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9348736-9790-425e-bf21-687b5e48e248 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.049937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.050539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.050822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.051095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.051713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.053665 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.146926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1270/2545] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:21.151025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.162431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e97e-d8ba-402a-9549-511afdf90b1d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.167032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.168031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.168384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.168663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.169308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.170909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.180894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1276/2546] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:21.185036 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.195100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfabde-42c9-4ba2-9995-b8dacb8f63e2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.200911 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.201501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.201776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.202046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.202677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.204403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b076-9963-4d55-bf6b-c44e44609407 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.215613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1271/2547] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:21.219841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.229820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460d315-0dd9-4260-b1f9-264f3e591ab6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.234969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.235640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.235963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.236291 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] PATH_INFO: `/v3/projects/72b5dd5045f041af8d802111d3cb43f5/users/751c46fb84364809919ebe829d38d113/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.251235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b5dd5045f041af8d802111d3cb43f5, user_id=751c46fb84364809919ebe829d38d113, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.253927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.366138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1277/2548] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:21 2022] PUT /identity/v3/projects/72b5dd5045f041af8d802111d3cb43f5/users/751c46fb84364809919ebe829d38d113/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:21.377281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.377594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.377832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.398831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:21.408389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] MFA Rules not processed for user `751c46fb84364809919ebe829d38d113`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:21.409608 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.487146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1272/2549] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:21.499093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.501166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.534622 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:21.575128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec62bb-d2b6-454d-a6a1-b4e9f195af62 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.581568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.582166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.582441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.582710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.591201 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.592810 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed6923-c091-45b2-86d0-ded7d3b14ffc service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.601407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1278/2550] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:21.816847 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.878996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b50a-199a-49dd-9581-debd727e6111 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.883481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.884192 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.884466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.884733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] PATH_INFO: `/v3/users/751c46fb84364809919ebe829d38d113` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.885921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751c46fb84364809919ebe829d38d113)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.887865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.034910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751c46fb84364809919ebe829d38d113'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.035564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751c46fb84364809919ebe829d38d113'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.042613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751c46fb84364809919ebe829d38d113'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.125840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751c46fb84364809919ebe829d38d113'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.139061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751c46fb84364809919ebe829d38d113'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.145065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1273/2551] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:21 2022] DELETE /identity/v3/users/751c46fb84364809919ebe829d38d113 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:22.149498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.149783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.150051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.168755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:22.169938 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.228358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1279/2552] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:22.238353 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.239744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.260108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:22.298375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28287a8-8540-49b1-8dd2-a00f23c24690 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.302745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.303346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.303622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.303926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.313655 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.315123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.324629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1274/2553] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:22.660089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.661569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.674350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfff57-1419-4a7f-a06b-384056e66f2f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.679018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.690675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.690675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.690675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] PATH_INFO: `/v3/users/fabadcdaf990421c9b26f94b1ac3091f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.690675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabadcdaf990421c9b26f94b1ac3091f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.690675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.825438 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.832856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.841314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1961a-a70a-4bb8-b453-b918c246f3df service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.846144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.846767 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.847041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.847315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] PATH_INFO: `/v3/projects/72b5dd5045f041af8d802111d3cb43f5` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.848443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b5dd5045f041af8d802111d3cb43f5)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.851114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.974088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabadcdaf990421c9b26f94b1ac3091f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.974727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabadcdaf990421c9b26f94b1ac3091f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.978188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b5dd5045f041af8d802111d3cb43f5', 'request_id': 'req-d1232296-bbec-4cbf-a407-6a290b563a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.984754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b5dd5045f041af8d802111d3cb43f5', 'request_id': 'req-d1232296-bbec-4cbf-a407-6a290b563a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:22.987320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabadcdaf990421c9b26f94b1ac3091f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.045680 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b5dd5045f041af8d802111d3cb43f5', 'request_id': 'req-d1232296-bbec-4cbf-a407-6a290b563a42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.056560 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] The token cache is being invalidate because project 72b5dd5045f041af8d802111d3cb43f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:23.056848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.057471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-d1232296-bbec-4cbf-a407-6a290b563a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.060171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1275/2554] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:22 2022] DELETE /identity/v3/projects/72b5dd5045f041af8d802111d3cb43f5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:23.065181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336402-c6ca-457c-90f9-89cc05b4c338 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.065467 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336402-c6ca-457c-90f9-89cc05b4c338 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.065744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336402-c6ca-457c-90f9-89cc05b4c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.089548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0d336402-c6ca-457c-90f9-89cc05b4c338 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:23.089548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0d336402-c6ca-457c-90f9-89cc05b4c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.144546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1276/2555] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:23.152490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.152807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.153037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.169710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabadcdaf990421c9b26f94b1ac3091f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.172159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:23.173354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.177390 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-951bd7f9-4c75-471a-b3ce-c6cf91dbfc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabadcdaf990421c9b26f94b1ac3091f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:23.181585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1277/2556] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:23.183547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1280/2557] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:22 2022] DELETE /identity/v3/users/fabadcdaf990421c9b26f94b1ac3091f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:23.188009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.188573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.188863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.189143 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.197627 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f19976-74e7-46fb-b628-94a9365f080c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.208320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:23.209526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.229451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:23.233001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:23.256082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.256688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.256963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.257232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.257869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:23.258169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.259770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.272015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1278/2558] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:23.273518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1281/2559] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:23.276705 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.283585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.285053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.287159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07058f6e-63e7-422a-a636-d7c8e1dbe2b8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.292468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.293113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.293414 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.293674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.296894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.301786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.343715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75692-deb9-4dba-beef-d5b7d9614a8b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.347328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.347963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.348243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.348516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.357955 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.360564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.368688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1282/2560] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:23.388861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1279/2561] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:23.390103 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.399606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc24f2f-4e66-4f06-9b46-f418cf46d4b9 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.459381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.460020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.460300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.460568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.461209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.463381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.558034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1283/2562] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:23.559992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.570862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a283e-8d6e-4c1d-a5c7-9313ef5ff26a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.576330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.576836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.577108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.577379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.578019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.579755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.594892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1280/2563] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:23.596769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.609133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5dff2-8845-4026-9074-fabab24c35dc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.613988 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.614628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.614911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.615183 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.615989 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.617590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a97-daf8-4cbc-a5bf-0e5112dd433d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.628312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1284/2564] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:23.632976 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.643593 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163035c6-b8da-4143-bf84-fa08e6abddec admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.648285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.648935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.649217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.649485 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] PATH_INFO: `/v3/projects/e679d231ed9e46d6be09c64cfb76f2d3/users/5640b6e716f94803a0f0aa0c2c8095f2/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.665613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e679d231ed9e46d6be09c64cfb76f2d3, user_id=5640b6e716f94803a0f0aa0c2c8095f2, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.669143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.736170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1281/2565] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:23 2022] PUT /identity/v3/projects/e679d231ed9e46d6be09c64cfb76f2d3/users/5640b6e716f94803a0f0aa0c2c8095f2/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:23.747982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.748455 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.748577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.776397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] MFA Rules not processed for user `5640b6e716f94803a0f0aa0c2c8095f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:23.778150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.796668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.798635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:23.831694 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:23.857868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1285/2566] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:23.862366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:23.872589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55505f04-2da5-4ae8-a333-8b317f2de13f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.873300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b123-ccfe-4aef-8e65-d3b802282dc5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:23.877507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.878562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.878562 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.879016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] PATH_INFO: `/v3/projects/711849ed41b247a0ad035c85bbdc9514` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.879939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=711849ed41b247a0ad035c85bbdc9514)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.880729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:23.881459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:23.881747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:23.881859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:23.882018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:23.882638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:23.884640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.000328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1286/2567] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:23 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:24.004738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.019032 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711849ed41b247a0ad035c85bbdc9514', 'request_id': 'req-90ea7109-443f-4179-8118-b3f06cdea36d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.025721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711849ed41b247a0ad035c85bbdc9514', 'request_id': 'req-90ea7109-443f-4179-8118-b3f06cdea36d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.080577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb044-56cf-4344-90fa-8371f5277715 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.143133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.143759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.144075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.144441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.145059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.146961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.206081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711849ed41b247a0ad035c85bbdc9514', 'request_id': 'req-90ea7109-443f-4179-8118-b3f06cdea36d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.217410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] The token cache is being invalidate because project 711849ed41b247a0ad035c85bbdc9514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:24.217700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.218389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.219981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1282/2568] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:23 2022] DELETE /identity/v3/projects/711849ed41b247a0ad035c85bbdc9514 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:24.223931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.225227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.235766 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:24.240755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1287/2569] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:24.242494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea7109-443f-4179-8118-b3f06cdea36d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.245242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.246214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.247520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.247663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.247808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.248105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] PATH_INFO: `/v3/users/b7c51e4ee0d74f58a85e9e14754ba906` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.249223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c51e4ee0d74f58a85e9e14754ba906)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.251118 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.259423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370734d-d668-4811-b8c2-0800ec14f4be admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.264331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.264928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.265205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.265474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.266114 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.267696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.277841 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1288/2570] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:24.288478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.298953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac16e-2137-4b20-aed8-4669b734b0f6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.303904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.304537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.304817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.305082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] PATH_INFO: `/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85/users/b28d3a9707374b4cab6f86a848baddbd/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.320781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8b38cdb9ef4ff38a326aa1f24c4a85, user_id=b28d3a9707374b4cab6f86a848baddbd, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.323414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.414905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1289/2571] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:24 2022] PUT /identity/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85/users/b28d3a9707374b4cab6f86a848baddbd/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:24.419367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.437917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:24.439000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c51e4ee0d74f58a85e9e14754ba906'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.439991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c51e4ee0d74f58a85e9e14754ba906'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.447931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c51e4ee0d74f58a85e9e14754ba906'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.479098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf9c0-8bac-4297-800d-ff8b0c0725b0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.484568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.485460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.485923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.486204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.487241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.488968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.499073 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1290/2572] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:24.503126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.504877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.511801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c51e4ee0d74f58a85e9e14754ba906'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.517534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31359eb-cf7d-4b36-be49-640b29d27448 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.523205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.523877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.524161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.524431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] PATH_INFO: `/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85/users/b28d3a9707374b4cab6f86a848baddbd/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.525769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7c1a4565-2b3a-4328-84c9-a38e375f6738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c51e4ee0d74f58a85e9e14754ba906'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:24.526337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8b38cdb9ef4ff38a326aa1f24c4a85, user_id=b28d3a9707374b4cab6f86a848baddbd, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.529669 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.533674 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1283/2573] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:24 2022] DELETE /identity/v3/users/b7c51e4ee0d74f58a85e9e14754ba906 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:24.542627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1291/2574] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:24 2022] PUT /identity/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85/users/b28d3a9707374b4cab6f86a848baddbd/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:24.553919 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.554206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.554480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.584897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] MFA Rules not processed for user `b28d3a9707374b4cab6f86a848baddbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:24.586116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.657454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1284/2575] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:24.674588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:24.674588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:24.732805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91ec1-ce80-4963-a446-21919ba103a1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:24.739328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:24.739328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:24.739328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:24.739328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:24.753007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:24.755066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:24.766369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1292/2576] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:25.001357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.002818 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:25.081350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3ef3a-a234-4551-959b-564e777b4ec2 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.085832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.086446 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.086719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.086981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] PATH_INFO: `/v3/projects/8e0500a60f314e709fb18fb0c2b92061` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.088146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0500a60f314e709fb18fb0c2b92061)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.090124 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.092530 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:25.207827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0500a60f314e709fb18fb0c2b92061', 'request_id': 'req-c32782ce-900f-42b5-8e54-b102c3b3c802'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.214164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0500a60f314e709fb18fb0c2b92061', 'request_id': 'req-c32782ce-900f-42b5-8e54-b102c3b3c802'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.292201 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0500a60f314e709fb18fb0c2b92061', 'request_id': 'req-c32782ce-900f-42b5-8e54-b102c3b3c802'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.310460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] The token cache is being invalidate because project 8e0500a60f314e709fb18fb0c2b92061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:25.310750 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.311399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.313030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1285/2577] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:25 2022] DELETE /identity/v3/projects/8e0500a60f314e709fb18fb0c2b92061 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:25.317022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.328614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd059ef-4495-4103-a2e3-fa87985a13ee service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.385815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.386467 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.386707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.387047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] PATH_INFO: `/v3/users/b61f44c6cac349abb6c16bf2c39dd572` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.388213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61f44c6cac349abb6c16bf2c39dd572)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.390121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.621449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:25.623124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61f44c6cac349abb6c16bf2c39dd572'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.623771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61f44c6cac349abb6c16bf2c39dd572'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.635927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61f44c6cac349abb6c16bf2c39dd572'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.717548 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61f44c6cac349abb6c16bf2c39dd572'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.724917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8cf7c2b7-9f62-48c3-a412-d80835edf232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61f44c6cac349abb6c16bf2c39dd572'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.731340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1293/2578] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:25 2022] DELETE /identity/v3/users/b61f44c6cac349abb6c16bf2c39dd572 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:25.750356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:25.751889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:25.765148 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32782ce-900f-42b5-8e54-b102c3b3c802 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:25.824585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:25.825713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:25.825996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:25.826268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] PATH_INFO: `/v3/users/5640b6e716f94803a0f0aa0c2c8095f2` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:25.827506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5640b6e716f94803a0f0aa0c2c8095f2)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:25.829470 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:25.999295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5640b6e716f94803a0f0aa0c2c8095f2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:25.999985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5640b6e716f94803a0f0aa0c2c8095f2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.007168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5640b6e716f94803a0f0aa0c2c8095f2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.068700 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5640b6e716f94803a0f0aa0c2c8095f2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.082496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5640b6e716f94803a0f0aa0c2c8095f2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.088501 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1286/2579] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:25 2022] DELETE /identity/v3/users/5640b6e716f94803a0f0aa0c2c8095f2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:26.093688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.094187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.094300 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.114077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:26.115270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.146572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.148425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.163543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:26.178332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1294/2580] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.188916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.190298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.219711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286cb-4b0f-4571-b28b-0970e9cd885e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.225238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.227129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.227129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.227129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] PATH_INFO: `/v3/projects/1ab3df0a92b04c69992b5f109791288a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.227628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab3df0a92b04c69992b5f109791288a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.229632 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.250850 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032eb2-6efe-4cdf-b202-65729e670602 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.254527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.255828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.255828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.255828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.264961 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.266374 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ac335-c4a7-4361-ad4b-64f4834b62ca service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.275596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1295/2581] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:26.338568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab3df0a92b04c69992b5f109791288a', 'request_id': 'req-51695200-acdc-4229-b3f4-bb736b94cf94'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.345188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab3df0a92b04c69992b5f109791288a', 'request_id': 'req-51695200-acdc-4229-b3f4-bb736b94cf94'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.428570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab3df0a92b04c69992b5f109791288a', 'request_id': 'req-51695200-acdc-4229-b3f4-bb736b94cf94'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.439722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] The token cache is being invalidate because project 1ab3df0a92b04c69992b5f109791288a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:26.440067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.440722 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51695200-acdc-4229-b3f4-bb736b94cf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:26.442222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1287/2582] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:26 2022] DELETE /identity/v3/projects/1ab3df0a92b04c69992b5f109791288a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:26.448209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.448491 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.448781 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.470441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:26.471651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.533308 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1296/2583] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.542224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.542511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.542782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.563571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:26.564803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.572812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1288/2584] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.578106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.588365 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3cadc-5c59-4451-8fa8-12f9cc23a594 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.596959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.596959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.596959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.596959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.597400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:26.597400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.597400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.598900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:26.610264 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1297/2585] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:26.614815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.625155 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f586d9-4948-414f-bb7a-d3f93f20553f None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.629944 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.630565 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.630823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.631096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.631711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.633886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.737235 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.740006 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.752736 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1289/2586] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:26.756613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.756763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a024-c622-4c8d-99cd-ebfb99d2fc79 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.826748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.827439 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.827667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.827978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] PATH_INFO: `/v3/projects/e679d231ed9e46d6be09c64cfb76f2d3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.828539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96264-09c2-4253-a877-954901f31195 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.829342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e679d231ed9e46d6be09c64cfb76f2d3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.831316 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.833327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.833927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.834203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.834528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.835272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.837782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.939093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1290/2587] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:26.940656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.945591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:26.951676 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98ff0-7fc4-4a47-ae8a-5b95eef1415e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.955452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e679d231ed9e46d6be09c64cfb76f2d3', 'request_id': 'req-6af3802d-d74f-4081-9538-6a5014c2bc4a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.008639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.009245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.009524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.009794 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.010431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.012256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.022346 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1291/2588] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:27.026186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e679d231ed9e46d6be09c64cfb76f2d3', 'request_id': 'req-6af3802d-d74f-4081-9538-6a5014c2bc4a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.026403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.033375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e679d231ed9e46d6be09c64cfb76f2d3', 'request_id': 'req-6af3802d-d74f-4081-9538-6a5014c2bc4a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.036018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430259-4b97-406a-b2db-acc5bda05eb7 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.040717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.041305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.041591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.041859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.042489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.044606 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.045474 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] The token cache is being invalidate because project e679d231ed9e46d6be09c64cfb76f2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:27.045787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.046451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.047983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1298/2589] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:26 2022] DELETE /identity/v3/projects/e679d231ed9e46d6be09c64cfb76f2d3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:27.051826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.053137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.058859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1292/2590] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:27.060784 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.062985 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.067259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3802d-d74f-4081-9538-6a5014c2bc4a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.072360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.074195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.074195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.074195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] PATH_INFO: `/v3/users/b28d3a9707374b4cab6f86a848baddbd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.075815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28d3a9707374b4cab6f86a848baddbd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.076718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144314-a3c2-449f-8cfb-efebe41584cd admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.077853 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.081374 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.082043 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.082321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.082594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] PATH_INFO: `/v3/projects/0082ef6e92c5470997df402c44b79349/users/4f913afcac304e368b379b2a76d50360/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.098971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0082ef6e92c5470997df402c44b79349, user_id=4f913afcac304e368b379b2a76d50360, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.101668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee72c-2b73-4539-a266-1dfb67bfe4f5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.229157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1293/2591] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:27 2022] PUT /identity/v3/projects/0082ef6e92c5470997df402c44b79349/users/4f913afcac304e368b379b2a76d50360/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:27.241070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.241356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.241629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.269195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] MFA Rules not processed for user `4f913afcac304e368b379b2a76d50360`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:27.270393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.299868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28d3a9707374b4cab6f86a848baddbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.300538 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28d3a9707374b4cab6f86a848baddbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.315397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28d3a9707374b4cab6f86a848baddbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.339254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1294/2592] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:27.344381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.345679 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.383366 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28d3a9707374b4cab6f86a848baddbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.390605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:27.393444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28d3a9707374b4cab6f86a848baddbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:27.400238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:27.406172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1299/2593] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:27 2022] DELETE /identity/v3/users/b28d3a9707374b4cab6f86a848baddbd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:27.414895 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78810301-da04-4bf6-b06b-c19ca9a7e15c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.474011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.474624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.474958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.475236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.475881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.477778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.608332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1295/2594] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:27 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:27.612573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.623299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cf1a-e64f-4fbe-80e9-3d4c6015c8fa admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.686340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.686957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.692659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.692659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.692659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.692659 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.801157 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1300/2595] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:27 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:27.805543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.816812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b982a1-bb37-49e1-84c2-be0ec331bb08 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.821430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.822018 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.822288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.822557 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.823249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.824883 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.835982 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1296/2596] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:27.840416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.850590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43054b6-9478-4cb0-9e0a-311d22134067 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.855293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.856680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.856957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.857256 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] PATH_INFO: `/v3/projects/b30c77efa8714cdea08827511ebaab97/users/07b1af05634f4e72a191f7ab2ffe1f8a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.872724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30c77efa8714cdea08827511ebaab97, user_id=07b1af05634f4e72a191f7ab2ffe1f8a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.875544 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.881789 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:27.884241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.897809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335d5a-79d2-4c8b-a398-91d686237e58 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.903415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.907376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.907376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.907376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] PATH_INFO: `/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.907376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8b38cdb9ef4ff38a326aa1f24c4a85)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.907971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.990106 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1301/2597] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:27 2022] PUT /identity/v3/projects/b30c77efa8714cdea08827511ebaab97/users/07b1af05634f4e72a191f7ab2ffe1f8a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:27.994343 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.032521 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8b38cdb9ef4ff38a326aa1f24c4a85', 'request_id': 'req-a67feb2f-1943-41da-8f02-8ecc49df6cf5'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:28.039134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8b38cdb9ef4ff38a326aa1f24c4a85', 'request_id': 'req-a67feb2f-1943-41da-8f02-8ecc49df6cf5'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:28.059167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07930-71a8-418c-ae58-b49b847b0128 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.092154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8b38cdb9ef4ff38a326aa1f24c4a85', 'request_id': 'req-a67feb2f-1943-41da-8f02-8ecc49df6cf5'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:28.104663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] The token cache is being invalidate because project 2c8b38cdb9ef4ff38a326aa1f24c4a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:28.104844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:28.106260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-a67feb2f-1943-41da-8f02-8ecc49df6cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:28.107908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1297/2598] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:27 2022] DELETE /identity/v3/projects/2c8b38cdb9ef4ff38a326aa1f24c4a85 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:28.112937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0336-e6e8-4e2a-a03e-82ed8b66bbb0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.113217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0336-e6e8-4e2a-a03e-82ed8b66bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.113482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f0336-e6e8-4e2a-a03e-82ed8b66bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.117760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.118360 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.118648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.118899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.119533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.121753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.131801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1302/2599] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:28.135969 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.137450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-143f0336-e6e8-4e2a-a03e-82ed8b66bbb0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:28.138559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.138779 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-143f0336-e6e8-4e2a-a03e-82ed8b66bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.146582 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1298/2600] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:28.147225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:28.151187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfe93-7999-4703-a66e-ef159c17c2e3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.155873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.156158 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.156270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.156431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.156877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.157138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.157406 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] PATH_INFO: `/v3/projects/b30c77efa8714cdea08827511ebaab97/users/07b1af05634f4e72a191f7ab2ffe1f8a/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.159348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30c77efa8714cdea08827511ebaab97, user_id=07b1af05634f4e72a191f7ab2ffe1f8a, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.162000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cbd11-3d70-431f-8f7b-72a6ef87b098 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.172845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1303/2601] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:28 2022] PUT /identity/v3/projects/b30c77efa8714cdea08827511ebaab97/users/07b1af05634f4e72a191f7ab2ffe1f8a/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:28.179059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:28.180370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.184227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.184516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.184785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.212559 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] MFA Rules not processed for user `07b1af05634f4e72a191f7ab2ffe1f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:28.213811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.229089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:28.244007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1299/2602] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:28.248340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.257056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dceb9f-5015-4d86-b4de-9fca05dca91a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.261620 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.262299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.262574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.262850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.263481 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:28.263793 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.267064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.276725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1300/2603] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:28.282241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.285399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1304/2604] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:28.295711 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73f48-f5b0-41f4-9b5c-a3577600f1a0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.297950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.301488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.302125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.302125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.302125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.302125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.302745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.304677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.360863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5428a-8264-43ca-b68e-de3c70a32adc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.364399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.365001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.365275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.365569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.375105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.376609 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.386038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1305/2605] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:28.416435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1301/2606] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:28.418148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.433328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ef258-2d41-4298-9235-6ceae2405234 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.491475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.492323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.492601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.492871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.493493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.495604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.495747 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.551286 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4316f6-b42d-4a03-bef8-819b905e6357 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.554998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.555588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.555897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.556165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.557875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.607400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1306/2607] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:28.611602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.622276 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.622970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b97e-cc9b-4c71-b057-2f65b950928f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.623713 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.628003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.628754 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.629037 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.629314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.629953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.631533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.632819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1302/2608] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:28.633937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:28.643149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1307/2609] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:28.647614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.659571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794e3f-3e7b-46e2-8665-205a910b12c9 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.664754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.665659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.666086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.666473 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.667344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.670037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f241bac-bb63-4aae-9617-acdee47c9e13 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.681550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1303/2610] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:28.686744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:28.696584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79fcd3-b7a5-44f6-8caf-a1eb3e23906e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:28.701597 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:28.702243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.702515 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.702782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] PATH_INFO: `/v3/projects/94460348724f4cff88b58f60626ddb36/users/32bd7982d47e45159e229ad7300e3ed6/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.719055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94460348724f4cff88b58f60626ddb36, user_id=32bd7982d47e45159e229ad7300e3ed6, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:28.722033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:28.832381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1308/2611] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:28 2022] PUT /identity/v3/projects/94460348724f4cff88b58f60626ddb36/users/32bd7982d47e45159e229ad7300e3ed6/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:28.843429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:28.843712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:28.844033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:28.872610 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] MFA Rules not processed for user `32bd7982d47e45159e229ad7300e3ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:28.873751 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:28.920465 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:28.938507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1304/2612] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:28.943272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.008355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38668-526d-493f-a723-0cc7f81a4506 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.013518 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.014119 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.014399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.014725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.015352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.017280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.115856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1309/2613] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:29.120022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.132242 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36253b-e290-45fb-9776-4b150ad40af2 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.188372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.188977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.189253 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.189524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.190149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.192121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.289505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1305/2614] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:29 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:29.296330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.307109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d5fc-9fbb-4bbe-a99c-1ea3f94f0b13 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.312963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.313571 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.313856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.314184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.314765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.316428 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.328511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1310/2615] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:29.332800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.350185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e044-dc81-46ea-84e1-71fe3bd70609 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.350185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.350185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.350185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.350574 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] PATH_INFO: `/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e/users/b4b283f6b2a84307bdcd1df11d3a18de/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.367216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dc0a158b4644f3aac31ce7686fb77e, user_id=b4b283f6b2a84307bdcd1df11d3a18de, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.370647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.473107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1306/2616] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:29 2022] PUT /identity/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e/users/b4b283f6b2a84307bdcd1df11d3a18de/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:29.477270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.487846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399bb1-4f61-4fb8-9ea1-bff5c549e091 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.551878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.552511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.552836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.553107 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.553744 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.555338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d8186-39a2-4f1b-9d3d-296a5ad310ad admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.566979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1311/2617] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:29.571175 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.582251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a591-4d9d-43d7-bd55-cf02aa6a973f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.587114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.587733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.588160 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.589377 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] PATH_INFO: `/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e/users/b4b283f6b2a84307bdcd1df11d3a18de/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.590403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dc0a158b4644f3aac31ce7686fb77e, user_id=b4b283f6b2a84307bdcd1df11d3a18de, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.593048 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.603372 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1307/2618] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:29 2022] PUT /identity/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e/users/b4b283f6b2a84307bdcd1df11d3a18de/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:29.614182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.614466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.614738 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.646219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] MFA Rules not processed for user `b4b283f6b2a84307bdcd1df11d3a18de`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:29.647425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:29.678849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:29.716372 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1312/2619] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:29.729330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:29.786830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bc082-e297-4773-ad25-cc972bce6169 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:29.790678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:29.791275 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:29.791549 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:29.791848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:29.800825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:29.802245 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:29.812886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1308/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:30.797834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:30.806831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb77054-7579-4988-84ab-8e0b152df9bf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:30.811646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4b283f6b2a84307bdcd1df11d3a18de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4dc0a158b4644f3aac31ce7686fb77e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:30.812271 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:30.812550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:30.812848 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:30.813496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:30.813820 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:30.815407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:30.827729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1313/2621] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:30.831923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:30.841917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae744-9f08-4630-9848-50fa579c6374 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:30.846533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4b283f6b2a84307bdcd1df11d3a18de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4dc0a158b4644f3aac31ce7686fb77e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:30.848769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:30.848769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:30.848769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:30.848769 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:30.850223 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:30.932806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1309/2622] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:30 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:30.938044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:30.948154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711334d4-862c-4181-85f9-6d8ad56a526a tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:31.006887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4b283f6b2a84307bdcd1df11d3a18de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4dc0a158b4644f3aac31ce7686fb77e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:31.007487 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:31.007767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:31.008074 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:31.008711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:31.009014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:31.010601 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:31.022075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1314/2623] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:31.058614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:31.068869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d42e-dcc2-4ad5-b659-600ac7fb5822 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:31.073548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4b283f6b2a84307bdcd1df11d3a18de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4dc0a158b4644f3aac31ce7686fb77e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:31.074437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:31.074594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:31.074832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] PATH_INFO: `/v3/projects/30d32dca5f894f5082333e61be3c14a0` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:31.076285 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30d32dca5f894f5082333e61be3c14a0)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:31.078170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:31.096490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:31.210433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d32dca5f894f5082333e61be3c14a0', 'request_id': 'req-71e917b5-0167-4a30-b879-eed04c8c73d6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:31.218735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d32dca5f894f5082333e61be3c14a0', 'request_id': 'req-71e917b5-0167-4a30-b879-eed04c8c73d6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:31.311900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d32dca5f894f5082333e61be3c14a0', 'request_id': 'req-71e917b5-0167-4a30-b879-eed04c8c73d6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:31.322922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] The token cache is being invalidate because project 30d32dca5f894f5082333e61be3c14a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:31.323209 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:31.323884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:31.326435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1310/2624] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:31 2022] DELETE /identity/v3/projects/30d32dca5f894f5082333e61be3c14a0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:31.724787 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:31.726591 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:31.792382 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38400e4b-12a9-4dac-8bfc-2ab264dde769 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:31.848771 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:31.857168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:31.857803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:31.858078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:31.858344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] PATH_INFO: `/v3/users/4f913afcac304e368b379b2a76d50360` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:31.860093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f913afcac304e368b379b2a76d50360)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:31.862340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:31.985235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:31.986775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.000862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e917b5-0167-4a30-b879-eed04c8c73d6 tempest-VolumeQuotaClassesTest-1659933349 tempest-VolumeQuotaClassesTest-1659933349-project-admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:32.005568 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:32.006241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.010760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.010760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] PATH_INFO: `/v3/users/32bd7982d47e45159e229ad7300e3ed6` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.010760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bd7982d47e45159e229ad7300e3ed6)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:32.010760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:32.041043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f913afcac304e368b379b2a76d50360'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.041726 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f913afcac304e368b379b2a76d50360'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.054325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f913afcac304e368b379b2a76d50360'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.123357 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f913afcac304e368b379b2a76d50360'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.131164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50549b13-d5fb-48c7-af2d-edcd69d6cc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f913afcac304e368b379b2a76d50360'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.138101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1315/2625] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:31 2022] DELETE /identity/v3/users/4f913afcac304e368b379b2a76d50360 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:32.142508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.142789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.143058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.161612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:32.162838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.221730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1316/2626] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:32.232187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:32.235211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.235861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bd7982d47e45159e229ad7300e3ed6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.236522 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bd7982d47e45159e229ad7300e3ed6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.244035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bd7982d47e45159e229ad7300e3ed6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.290821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8a72b-ed5a-4c87-bb4e-8416ca7bb749 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:32.295407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:32.296041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.296318 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.296585 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.298328 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.312861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:32.314303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb770a76-1713-4da0-9a62-6ab0288f74ee service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:32.324054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1317/2627] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:32.334881 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bd7982d47e45159e229ad7300e3ed6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.348356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bd7982d47e45159e229ad7300e3ed6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.354725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1311/2628] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:31 2022] DELETE /identity/v3/users/32bd7982d47e45159e229ad7300e3ed6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:32.360019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.360305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.360575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.380313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:32.381615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.395294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:32.444131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1318/2629] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:32.455269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:32.456689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.515512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124cb1-f7dd-4edc-b97b-64dfbda16046 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:32.519272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:32.519912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.520188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.520454 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.535946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:32.535946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:32.541389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1312/2630] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:32.737194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:32.738752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:32.762513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a5362-96aa-4ec8-aa07-e24d8c2fee79 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:32.770314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:32.771375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:32.771657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:32.771995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] PATH_INFO: `/v3/projects/0082ef6e92c5470997df402c44b79349` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:32.773234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0082ef6e92c5470997df402c44b79349)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:32.786982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:32.915096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0082ef6e92c5470997df402c44b79349', 'request_id': 'req-053ae65b-c83d-41d8-aaf9-71db4b0e9142'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:32.989370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:32.990788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:33.006182 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0082ef6e92c5470997df402c44b79349', 'request_id': 'req-053ae65b-c83d-41d8-aaf9-71db4b0e9142'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.009548 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc523-3cb0-4cb0-b1dd-75a753d1b2f2 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:33.016000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0082ef6e92c5470997df402c44b79349', 'request_id': 'req-053ae65b-c83d-41d8-aaf9-71db4b0e9142'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.026536 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] The token cache is being invalidate because project 0082ef6e92c5470997df402c44b79349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:33.026828 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.028594 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.029659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:33.030151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1319/2631] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:32 2022] DELETE /identity/v3/projects/0082ef6e92c5470997df402c44b79349 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:33.034121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:33.035521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:33.070067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:33.070843 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:33.071127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:33.071397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] PATH_INFO: `/v3/projects/94460348724f4cff88b58f60626ddb36` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:33.072624 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=94460348724f4cff88b58f60626ddb36)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:33.075672 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:33.102408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ae65b-c83d-41d8-aaf9-71db4b0e9142 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:33.107233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:33.107888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:33.109970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:33.109970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] PATH_INFO: `/v3/users/07b1af05634f4e72a191f7ab2ffe1f8a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:33.109970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b1af05634f4e72a191f7ab2ffe1f8a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:33.111507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:33.180920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94460348724f4cff88b58f60626ddb36', 'request_id': 'req-8bbc4377-f735-4177-9830-4649855ac7fa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.187217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94460348724f4cff88b58f60626ddb36', 'request_id': 'req-8bbc4377-f735-4177-9830-4649855ac7fa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.274447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94460348724f4cff88b58f60626ddb36', 'request_id': 'req-8bbc4377-f735-4177-9830-4649855ac7fa'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.285119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] The token cache is being invalidate because project 94460348724f4cff88b58f60626ddb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:33.285435 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.286075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.287575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1313/2632] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:32 2022] DELETE /identity/v3/projects/94460348724f4cff88b58f60626ddb36 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:33.291580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:33.292893 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:33.358442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4377-f735-4177-9830-4649855ac7fa admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:33.363095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:33.363718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:33.364145 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:33.364425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] PATH_INFO: `/v3/users/b4b283f6b2a84307bdcd1df11d3a18de` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:33.365600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b283f6b2a84307bdcd1df11d3a18de)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:33.367516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:33.378871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:33.380391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b1af05634f4e72a191f7ab2ffe1f8a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.381105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b1af05634f4e72a191f7ab2ffe1f8a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.392914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b1af05634f4e72a191f7ab2ffe1f8a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.469077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b1af05634f4e72a191f7ab2ffe1f8a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.476276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b1af05634f4e72a191f7ab2ffe1f8a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.482514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1320/2633] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:33 2022] DELETE /identity/v3/users/07b1af05634f4e72a191f7ab2ffe1f8a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:33.575717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b283f6b2a84307bdcd1df11d3a18de'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.576421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b283f6b2a84307bdcd1df11d3a18de'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.581010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:33.585694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b283f6b2a84307bdcd1df11d3a18de'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.680640 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b283f6b2a84307bdcd1df11d3a18de'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.693669 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b283f6b2a84307bdcd1df11d3a18de'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:33.701531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1314/2634] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:33 2022] DELETE /identity/v3/users/b4b283f6b2a84307bdcd1df11d3a18de => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:33.888782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:33.892438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:33.977811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092792-08b7-4ed8-882c-fe66cd08584f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.039453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.040108 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.040384 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.040653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] PATH_INFO: `/v3/projects/b30c77efa8714cdea08827511ebaab97` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.041788 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30c77efa8714cdea08827511ebaab97)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.045824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.168922 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.170464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.184952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7f1c0-ce82-4eae-b8e9-a6cc663f12eb admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.210097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30c77efa8714cdea08827511ebaab97', 'request_id': 'req-2e06baaa-619e-4c7f-b530-cd2c2629dd51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.256814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.257451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.257723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.257992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] PATH_INFO: `/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.259131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4dc0a158b4644f3aac31ce7686fb77e)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.261061 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.331613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30c77efa8714cdea08827511ebaab97', 'request_id': 'req-2e06baaa-619e-4c7f-b530-cd2c2629dd51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.339034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30c77efa8714cdea08827511ebaab97', 'request_id': 'req-2e06baaa-619e-4c7f-b530-cd2c2629dd51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.346468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:34.350213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] The token cache is being invalidate because project b30c77efa8714cdea08827511ebaab97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:34.350500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.351135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e06baaa-619e-4c7f-b530-cd2c2629dd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.352653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1321/2635] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:33 2022] DELETE /identity/v3/projects/b30c77efa8714cdea08827511ebaab97 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:34.358648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e8ec-429b-4713-b0cf-b8d971cd09ef None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.359067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e8ec-429b-4713-b0cf-b8d971cd09ef None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.359403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e8ec-429b-4713-b0cf-b8d971cd09ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.378666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4dc0a158b4644f3aac31ce7686fb77e', 'request_id': 'req-0d043559-5c30-43b9-89d6-416acd0f2d80'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.382019 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dd12e8ec-429b-4713-b0cf-b8d971cd09ef None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:34.383423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dd12e8ec-429b-4713-b0cf-b8d971cd09ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.384865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4dc0a158b4644f3aac31ce7686fb77e', 'request_id': 'req-0d043559-5c30-43b9-89d6-416acd0f2d80'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.444102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1322/2636] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:34.452331 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.452614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.452883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.456941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4dc0a158b4644f3aac31ce7686fb77e', 'request_id': 'req-0d043559-5c30-43b9-89d6-416acd0f2d80'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.468533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] The token cache is being invalidate because project f4dc0a158b4644f3aac31ce7686fb77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:34.468827 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.469471 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0d043559-5c30-43b9-89d6-416acd0f2d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:34.470955 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1315/2637] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:34 2022] DELETE /identity/v3/projects/f4dc0a158b4644f3aac31ce7686fb77e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:34.472643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:34.473834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.475668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0086-1e29-4ef0-a52f-1ec3c9b93832 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.475983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0086-1e29-4ef0-a52f-1ec3c9b93832 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.476255 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0086-1e29-4ef0-a52f-1ec3c9b93832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.484539 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1323/2638] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:34.492589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.497128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-641b0086-1e29-4ef0-a52f-1ec3c9b93832 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:34.498432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-641b0086-1e29-4ef0-a52f-1ec3c9b93832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.502125 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6105e-6e91-4d3b-819f-39c99617c09e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.506441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1316/2639] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:34.506615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.507342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.507496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.507764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.508433 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:34.508748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.510340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.515469 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.518171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.518171 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.523095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1324/2640] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:34.527097 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.535509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:34.536734 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:34.537472 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280321-9e5d-406b-a70c-b554f34d4c99 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.543503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.546775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.546775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.546775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.547051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1317/2641] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:34.547133 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.547537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.549489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.558462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7a9bf-7efe-47be-bc2c-bf2d17f9a282 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.563889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.564517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.564799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.565071 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.565721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:34.566016 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.567604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.580095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1318/2642] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:34.584330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.594287 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daa1ec-6274-409f-8b43-a1c5043fe47c admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.599928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.604295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.604295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.604295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.604295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.604295 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.633214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1325/2643] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:34.637501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.698224 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2789da-47e3-4704-9bbe-80343761e0dd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.698896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1319/2644] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:34.703423 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.716690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:34.757761 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.758368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.758730 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.759010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.759673 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.761593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.770343 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e4cb4-606f-4619-8172-dd79bb13b5a3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.773427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:34.776267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.776867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.777173 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.778096 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.778716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.780653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.872769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1326/2645] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:34.876812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.886258 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff985-72de-418e-be4a-b01599e41f77 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.892450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.895166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.895166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.895166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.895166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.895948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.897584 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1320/2646] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:34 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:34.901630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.910156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1327/2647] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:34.911220 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.914305 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b68d-0958-485e-99b4-aa96f9afdb58 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.919256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.919875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.920150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.923845 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.923953 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef58d9-644a-4687-89bc-d9c25704dccf admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.924046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.924046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.925708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.926299 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.926576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.926844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.927466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.929102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.933206 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1321/2648] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:34.937825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.939958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1328/2649] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:34.943688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.947937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711417-fad2-4a40-ba36-839e54361362 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.953527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.954040 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db035-ba1b-49dd-84ea-55699cb51738 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.954146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.954325 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.954654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.955225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.957000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.959556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.960243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.960521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.960794 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] PATH_INFO: `/v3/projects/e88ffbf9c625452cb950c3ee8ca023cf/users/3605d0a709584776bbfb5db6b3e7e846/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:34.969812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1322/2650] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:34.973980 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:34.977782 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88ffbf9c625452cb950c3ee8ca023cf, user_id=3605d0a709584776bbfb5db6b3e7e846, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:34.981215 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadf243-7fdc-493c-8d87-d5ad0ef4632b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:34.984258 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82febd68-6bfa-46a4-ac8e-6bbe1f85fd99 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:34.988994 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:34.989663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:34.989937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:34.992721 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] PATH_INFO: `/v3/projects/0b4428876c684141b13e7afca01bee65/users/ebfcb8e5cff6433ab33c4d33837632c2/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.004648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4428876c684141b13e7afca01bee65, user_id=ebfcb8e5cff6433ab33c4d33837632c2, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.007239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64639b2-21f8-4fdb-b0c9-42c4181f7ef8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.046124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1329/2651] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:34 2022] PUT /identity/v3/projects/e88ffbf9c625452cb950c3ee8ca023cf/users/3605d0a709584776bbfb5db6b3e7e846/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:35.050913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.051200 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.051475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.069732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:35.070933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:35.108547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1323/2652] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:34 2022] PUT /identity/v3/projects/0b4428876c684141b13e7afca01bee65/users/ebfcb8e5cff6433ab33c4d33837632c2/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:35.120514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.120808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.121683 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.132784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1330/2653] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:35.145486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.146968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:35.150884 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] MFA Rules not processed for user `ebfcb8e5cff6433ab33c4d33837632c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:35.152080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:35.208430 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c16a1-098f-4988-a30c-3b16ffb087d5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.222639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1324/2654] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:35.227278 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.259189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.259801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.260096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.260368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.274475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:35.280314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:35.291594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec3ea-f119-479b-a998-d0bf8e141f43 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.302161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.302770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.303044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.303313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.303972 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.305860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.324965 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.326668 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.336414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1331/2655] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:35.399149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1325/2656] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:35 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:35.403513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.413338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaaa41-2ea9-475f-94a5-736dec402186 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.474175 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.474709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.474984 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.475253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.475902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.477845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.594807 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1332/2657] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:35 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:35.598739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.609306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797b05f-03fc-4687-8100-6fe0a70ada7d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.614251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.614849 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.615138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.615515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.616184 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.617797 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.633115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1326/2658] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:35.634284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.646028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70549-2089-48ed-a403-0a3ee2d7e7d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.650977 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.658402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.658402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.658402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] PATH_INFO: `/v3/projects/5a77101f35994526a2ad4ae372659f4a/users/a6bc08a20a75409cae03a20767ef523b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.669198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a77101f35994526a2ad4ae372659f4a, user_id=a6bc08a20a75409cae03a20767ef523b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.672023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.735543 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1333/2659] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:35 2022] PUT /identity/v3/projects/5a77101f35994526a2ad4ae372659f4a/users/a6bc08a20a75409cae03a20767ef523b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:35.739487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.750889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b46fd-ca28-4c16-ad7a-63daa2c46e5a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.810630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.811224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.811500 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.811771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.812445 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.814224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bf772-cecb-4851-8cd3-ef7443b70367 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.825389 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1327/2660] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:35.830776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:35.841934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d19dff-899e-466a-bd3e-e7e218d4b4fd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:35.846755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:35.847407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.847718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.848050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] PATH_INFO: `/v3/projects/5a77101f35994526a2ad4ae372659f4a/users/a6bc08a20a75409cae03a20767ef523b/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.850196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a77101f35994526a2ad4ae372659f4a, user_id=a6bc08a20a75409cae03a20767ef523b, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:35.852874 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:35.864423 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1334/2661] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:35 2022] PUT /identity/v3/projects/5a77101f35994526a2ad4ae372659f4a/users/a6bc08a20a75409cae03a20767ef523b/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:35.876966 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:35.877296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:35.877571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:35.906589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] MFA Rules not processed for user `a6bc08a20a75409cae03a20767ef523b`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:35.907821 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:35.988000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1328/2662] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:36.000025 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:36.001891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:36.064521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01034b2-e87c-470c-8831-4e6d2a3ae9d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:36.068348 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:36.068957 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.069238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.069512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.079891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:36.081446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3d8c1-ae13-49bc-a30d-a5c16b6cfe86 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:36.092325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1335/2663] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:36.232677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:36.277646 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:36.304867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461bab4-8547-4c06-a8bc-0e2f13ddb588 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:36.310365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:36.311034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.311238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.311577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] PATH_INFO: `/v3/users/ebfcb8e5cff6433ab33c4d33837632c2` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.313106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfcb8e5cff6433ab33c4d33837632c2)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:36.315181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:36.494867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfcb8e5cff6433ab33c4d33837632c2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:36.495535 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfcb8e5cff6433ab33c4d33837632c2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:36.502686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfcb8e5cff6433ab33c4d33837632c2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:36.571490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfcb8e5cff6433ab33c4d33837632c2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:36.585380 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-44cf441c-dd2a-4b20-b15d-6895771ccc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfcb8e5cff6433ab33c4d33837632c2'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:36.592487 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1329/2664] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:36 2022] DELETE /identity/v3/users/ebfcb8e5cff6433ab33c4d33837632c2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:36.597228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613e45-d370-4845-8869-847fce601894 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.597513 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613e45-d370-4845-8869-847fce601894 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.597786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613e45-d370-4845-8869-847fce601894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.615658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.615986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.616349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.624168 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ea613e45-d370-4845-8869-847fce601894 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:36.628298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ea613e45-d370-4845-8869-847fce601894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:36.633327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:36.656780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] MFA Rules not processed for user `3605d0a709584776bbfb5db6b3e7e846`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:36.658027 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:36.696907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1336/2665] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:36.707888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613e45-d370-4845-8869-847fce601894 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:36.709582 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ea613e45-d370-4845-8869-847fce601894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:36.731248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1330/2666] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:36.743904 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:36.745359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:36.779049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613e45-d370-4845-8869-847fce601894 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:36.783039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:36.783639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.784042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.784312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.793680 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:36.795100 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:36.800466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:36.804801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14b497-dea9-4d03-afd7-158c885c311a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:36.808424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:36.811614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:36.811614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:36.811614 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:36.812531 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1337/2667] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:36.818365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:36.819805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:36.830327 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1331/2668] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:37.207777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:37.209213 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:37.224379 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013628-39a6-4b6e-b488-a53d3d4f6df7 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:37.229041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:37.230181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:37.231380 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:37.231941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] PATH_INFO: `/v3/projects/0b4428876c684141b13e7afca01bee65` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:37.233138 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4428876c684141b13e7afca01bee65)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:37.235092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:37.335766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4428876c684141b13e7afca01bee65', 'request_id': 'req-740f61d1-2b7f-4979-81cb-7f8659564355'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.403606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4428876c684141b13e7afca01bee65', 'request_id': 'req-740f61d1-2b7f-4979-81cb-7f8659564355'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.410478 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4428876c684141b13e7afca01bee65', 'request_id': 'req-740f61d1-2b7f-4979-81cb-7f8659564355'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.421927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] The token cache is being invalidate because project 0b4428876c684141b13e7afca01bee65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:37.422218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.422842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.424401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1338/2669] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:37 2022] DELETE /identity/v3/projects/0b4428876c684141b13e7afca01bee65 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:37.428397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:37.439739 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119a8e9-18d1-462b-a7bc-4a3b576bacec service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:37.502835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:37.503519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:37.503820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:37.504097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] PATH_INFO: `/v3/users/a6bc08a20a75409cae03a20767ef523b` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:37.510140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bc08a20a75409cae03a20767ef523b)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:37.510140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:37.763575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bc08a20a75409cae03a20767ef523b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.764235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bc08a20a75409cae03a20767ef523b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.771176 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bc08a20a75409cae03a20767ef523b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.839803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bc08a20a75409cae03a20767ef523b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.852297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-b4b72764-593b-4f6a-8cc1-50be2931d6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bc08a20a75409cae03a20767ef523b'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:37.858555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1332/2670] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:37 2022] DELETE /identity/v3/users/a6bc08a20a75409cae03a20767ef523b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:38.251092 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:38.252750 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:38.267450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f61d1-2b7f-4979-81cb-7f8659564355 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:38.302866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:38.326173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:38.326824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.327099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.327368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] PATH_INFO: `/v3/projects/5a77101f35994526a2ad4ae372659f4a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.328497 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a77101f35994526a2ad4ae372659f4a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:38.330388 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:38.438000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a77101f35994526a2ad4ae372659f4a', 'request_id': 'req-6b52bf28-b079-4e52-84c2-c57b39e07a39'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:38.505642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a77101f35994526a2ad4ae372659f4a', 'request_id': 'req-6b52bf28-b079-4e52-84c2-c57b39e07a39'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:38.512526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a77101f35994526a2ad4ae372659f4a', 'request_id': 'req-6b52bf28-b079-4e52-84c2-c57b39e07a39'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:38.523334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] The token cache is being invalidate because project 5a77101f35994526a2ad4ae372659f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:38.523652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:38.524344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6b52bf28-b079-4e52-84c2-c57b39e07a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:38.525849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1339/2671] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:38 2022] DELETE /identity/v3/projects/5a77101f35994526a2ad4ae372659f4a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:38.531671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd16df-f9a0-4d2a-9c04-16935acb8d39 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.532177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd16df-f9a0-4d2a-9c04-16935acb8d39 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.532334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd16df-f9a0-4d2a-9c04-16935acb8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.551921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-88fd16df-f9a0-4d2a-9c04-16935acb8d39 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:38.553129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-88fd16df-f9a0-4d2a-9c04-16935acb8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:38.577320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.577606 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.577882 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.598931 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] MFA Rules not processed for user `3605d0a709584776bbfb5db6b3e7e846`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:38.600167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:38.618787 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1333/2672] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:38.626718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.626998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.627267 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.647113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:38.648356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:38.657172 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1334/2673] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:38.658764 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1340/2674] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:38.661413 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:38.667179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:38.671912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cede84-a43a-4ba3-bc7d-b4f28f16f0e0 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:38.676670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:38.677291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.677567 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.677842 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.678510 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:38.678828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:38.680439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:38.695820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1335/2675] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:47:38.697566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:38.710745 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764fbbe-7ed5-41a0-b0fa-4801aa55ba07 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:38.716907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:38.717665 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.717867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.718120 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.718859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:38.720774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:38.831156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1341/2676] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:38.835196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:38.845670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46057a-4745-4096-9a0c-5cff2c9da7b7 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:38.904685 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:38.905294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:38.905570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:38.905840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:38.906466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:38.908436 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.044144 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1336/2677] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:38 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:39.045302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:39.055684 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c622c-9d55-4d1f-b139-627149422e01 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:39.060670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:39.061408 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.061684 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.061951 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.062587 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:39.064279 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.074879 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1342/2678] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:39.081502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:39.092298 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7529d3-7289-4543-a830-d76d7651b5a6 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:39.097425 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:39.098086 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.098426 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.098814 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.099589 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:39.101492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e3085-b46e-4978-b4aa-24c9dd111d49 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.111644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1337/2679] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:39.116035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:39.126320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfe00-69a5-447d-9888-24c9adcb4e90 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:39.130895 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:39.131612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.132147 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.132325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] PATH_INFO: `/v3/projects/9de0465965c64d449f88a6e904aaa28c/users/9f4d7f44fe984c059ed1feb9f05bef8f/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.147880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de0465965c64d449f88a6e904aaa28c, user_id=9f4d7f44fe984c059ed1feb9f05bef8f, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:39.150660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.269128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1343/2680] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:39 2022] PUT /identity/v3/projects/9de0465965c64d449f88a6e904aaa28c/users/9f4d7f44fe984c059ed1feb9f05bef8f/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:39.279542 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.279863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.280143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.314115 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] MFA Rules not processed for user `9f4d7f44fe984c059ed1feb9f05bef8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:39.315418 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:39.394490 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1338/2681] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:39.409098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:39.411894 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:39.433836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:39.476403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9669-d5fc-4401-83fc-078d46f21a48 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:39.481492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:39.487272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:39.487272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:39.487272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:39.491537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:39.493013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f903-bb09-497c-adf6-bbec1e7d6592 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:39.502052 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1344/2682] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:46.507906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:46.571760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af150f-73a9-49d1-a869-6984b486bbce None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:46.577140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:46.577763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.578040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.578311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] PATH_INFO: `/v3/users/9f4d7f44fe984c059ed1feb9f05bef8f` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.579424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4d7f44fe984c059ed1feb9f05bef8f)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:46.581358 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:46.582879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:46.757351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4d7f44fe984c059ed1feb9f05bef8f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:46.758261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4d7f44fe984c059ed1feb9f05bef8f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:46.765448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4d7f44fe984c059ed1feb9f05bef8f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:46.848995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4d7f44fe984c059ed1feb9f05bef8f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:46.862572 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4d7f44fe984c059ed1feb9f05bef8f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:46.869600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1339/2683] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:46 2022] DELETE /identity/v3/users/9f4d7f44fe984c059ed1feb9f05bef8f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:46.874033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:46.874519 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:46.874800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:46.894033 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:46.895230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:46.954547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1345/2684] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:46.964283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:46.966354 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.022813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c581-cbb1-442a-9925-a4d813870c65 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:47.026444 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:47.027641 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.027945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.028213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.037002 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:47.038432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e427-ba3f-4552-a7ac-cbf5895d5c8d service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:47.048378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1340/2685] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:47.505753 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:47.507325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.523508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f811ed-ca20-4382-adc7-caf405f046cf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:47.529101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:47.529742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.530022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.530281 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] PATH_INFO: `/v3/projects/9de0465965c64d449f88a6e904aaa28c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.531416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de0465965c64d449f88a6e904aaa28c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:47.533389 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:47.646404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de0465965c64d449f88a6e904aaa28c', 'request_id': 'req-1e51bec7-94f3-4286-839e-a66f8c3a9a26'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:47.722824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de0465965c64d449f88a6e904aaa28c', 'request_id': 'req-1e51bec7-94f3-4286-839e-a66f8c3a9a26'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:47.729468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de0465965c64d449f88a6e904aaa28c', 'request_id': 'req-1e51bec7-94f3-4286-839e-a66f8c3a9a26'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:47.742776 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] The token cache is being invalidate because project 9de0465965c64d449f88a6e904aaa28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:47.743842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:47.745170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1e51bec7-94f3-4286-839e-a66f8c3a9a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:47.747529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1346/2686] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:47 2022] DELETE /identity/v3/projects/9de0465965c64d449f88a6e904aaa28c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:47.752621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.753126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.753126 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.772659 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:47.773850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.831663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1341/2687] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:47.841272 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.841558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.841827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.861623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:47.862802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:47.870562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1347/2688] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:47.874820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:47.884575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de29c1-5d45-4c04-a31c-b9395aaa1b16 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:47.889448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:47.890031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.890310 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.890579 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.891220 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:47.891520 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:47.893151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:47.905269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1342/2689] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:47.909526 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:47.919099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57955-f1b1-4725-84be-43a2765198b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:47.923707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:47.924327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:47.924602 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:47.924870 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:47.925511 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:47.927370 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.024891 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1348/2690] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:47 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:48.030062 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.039977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dedd4-58ea-4b4f-95ba-d09fe9578c16 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.045222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:48.100488 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.101037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.101318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.101590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.102241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.104340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.217938 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1343/2691] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:48 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:48.221999 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.232381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906688dc-a692-40bf-b9fa-62ec45544b91 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.236914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.237493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.237769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.238038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.238675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.240282 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.250502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1349/2692] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:48.254792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.265551 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47740d0-321b-4326-a4dd-f32c48268b60 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.270154 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.270802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.271072 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.271338 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.272024 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.273671 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc63b-61c4-4a60-b528-8bc2ea0beed7 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.285386 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1344/2693] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:48.289653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.300501 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631966-b0b2-4dae-b556-6e5d7999006e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.301824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:48.306367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.309417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.309417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.309417 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] PATH_INFO: `/v3/projects/ff93d13bad5f448882dea687f9cf0f7a/users/8c79fd10cc214eedaed558a0d47c8450/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.326621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff93d13bad5f448882dea687f9cf0f7a, user_id=8c79fd10cc214eedaed558a0d47c8450, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.329381 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.408616 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1350/2694] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:48 2022] PUT /identity/v3/projects/ff93d13bad5f448882dea687f9cf0f7a/users/8c79fd10cc214eedaed558a0d47c8450/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:48.419805 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.420123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.420397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.450200 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] MFA Rules not processed for user `8c79fd10cc214eedaed558a0d47c8450`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:48.451378 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:48.515862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1345/2695] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:48.520355 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.584353 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510b29-fd07-466f-847a-6988ddb60154 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.589083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.589686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.590564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.590766 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.591364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.593311 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.705462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1351/2696] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:48 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:47:48.706908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.718526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63233-0a07-4a8b-b97f-d1825d3ef855 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.780771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.781447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.781613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.781882 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.782607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.784649 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.861293 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1346/2697] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:48 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:48.865261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.876189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a59fd1-f756-4342-903c-47c15f224d96 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.880898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.881564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.889566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.889566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.889566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.889566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.896076 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1352/2698] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:48.900046 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.910998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4c90-9a3b-4dce-a02f-9e005458405a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.915489 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.916107 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.916384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.916654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.917288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.919111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ebc29-6e79-4137-b6cd-96df5f7acfdf admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:48.920381 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:48.929528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1347/2699] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:48.937762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:48.947803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824b299-b5ce-460f-b0d0-5051f81b573c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:48.953557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:48.954193 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:48.954469 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:48.954760 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] PATH_INFO: `/v3/projects/cb765572879c4c0594eb8addff3525d2/users/7564141c722c4c679ac3d5203d106da6/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:48.969861 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb765572879c4c0594eb8addff3525d2, user_id=7564141c722c4c679ac3d5203d106da6, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:48.972507 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.033956 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1353/2700] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:48 2022] PUT /identity/v3/projects/cb765572879c4c0594eb8addff3525d2/users/7564141c722c4c679ac3d5203d106da6/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:49.044929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.045214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.045516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.073226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] MFA Rules not processed for user `7564141c722c4c679ac3d5203d106da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:49.074509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:49.138686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1348/2701] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:49.143192 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.205196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ca49-c887-4eb6-8aff-7d6fe8fd56f3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.209836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.210431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.210708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.210978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.211595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.213520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.315889 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1354/2702] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:49 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:49.320087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.331312 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ac93d-60b9-41de-8452-fc1ae0a459ee None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.388687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.389315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.389591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.389855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.390480 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.392433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.463128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1349/2703] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:49 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:49.468042 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.478163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d097-6da0-4080-b337-d976d899e5bc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.482912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.483499 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.483775 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.484066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.484696 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.486269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.497420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1355/2704] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:49.501626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.512237 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b5f9-4331-4f07-a70c-fe046bd381ae admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.516960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.517600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.517874 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.518166 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] PATH_INFO: `/v3/projects/e9fac58949db473298d7674278231132/users/4ee86d7986b64d6383de9697efdcda42/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.533550 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9fac58949db473298d7674278231132, user_id=4ee86d7986b64d6383de9697efdcda42, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.536266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.626216 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1350/2705] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:49 2022] PUT /identity/v3/projects/e9fac58949db473298d7674278231132/users/4ee86d7986b64d6383de9697efdcda42/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:49.630210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.635556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:49.642041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48138f2-248f-42b7-8896-ebfc805870d0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.696971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.697554 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.697834 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.698105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.698852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.701627 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726c1af-8d6d-45de-85c8-67343e415f6c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.712352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1356/2706] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:49.717524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.727927 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ef3d-6b30-4747-a1f5-9e432294147b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:49.732941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:49.733630 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.733913 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.734185 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] PATH_INFO: `/v3/projects/e9fac58949db473298d7674278231132/users/4ee86d7986b64d6383de9697efdcda42/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.736169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9fac58949db473298d7674278231132, user_id=4ee86d7986b64d6383de9697efdcda42, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:49.738771 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:49.749248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1351/2707] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:49 2022] PUT /identity/v3/projects/e9fac58949db473298d7674278231132/users/4ee86d7986b64d6383de9697efdcda42/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:49.819251 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:49.819534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:49.819912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:49.851549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] MFA Rules not processed for user `4ee86d7986b64d6383de9697efdcda42`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:49.852805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:49.927461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1357/2708] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:49.939157 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:49.940981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:49.989031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:50.004193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038d44-2fc4-42f1-8ef8-ee8e84ae3721 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:50.008513 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:50.009296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:50.009578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:50.009840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:50.071339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:50.073073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:50.083211 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1352/2709] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:52.207851 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:52.209912 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:52.222638 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32eba-06cd-48f3-ae5c-c73794afcb4f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:52.226342 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:52.227010 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:52.227284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:52.227558 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:52.293017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:52.295516 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6424-b32b-48cd-a07a-3732a1ce94a6 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:52.307105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1358/2710] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:53.698239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:53.707905 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071e2e-97cf-4f27-b9a6-192a31686f1e service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:53.711540 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:53.712168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:53.712448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:53.712719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:53.722592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:53.724111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:53.733950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1353/2711] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:58.289767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:58.290261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:58.290363 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:58.311561 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] MFA Rules not processed for user `3605d0a709584776bbfb5db6b3e7e846`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:58.312925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:58.331396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:58.372576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1359/2712] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:58.526888 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:58.593512 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22616e-c2b0-4954-8ebb-eba4c514426b service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:58.598581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:58.599341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:58.599644 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:58.599952 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] PATH_INFO: `/v3/users/8c79fd10cc214eedaed558a0d47c8450` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:58.601230 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c79fd10cc214eedaed558a0d47c8450)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:58.603337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:58.616399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:58.617800 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:58.676151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc18ac-aa23-454f-8a69-13e65aee32c8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:58.679947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:58.682527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:58.682527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:58.682527 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:58.682845 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:58.692481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:58.693900 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c18510-7934-4f2b-97d6-702a26036bd9 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:58.703080 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1360/2713] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:58.831291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c79fd10cc214eedaed558a0d47c8450'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:58.832026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c79fd10cc214eedaed558a0d47c8450'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:58.839808 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c79fd10cc214eedaed558a0d47c8450'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:58.896440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c79fd10cc214eedaed558a0d47c8450'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:58.909824 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c79fd10cc214eedaed558a0d47c8450'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:58.911515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:58.917349 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1354/2714] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:58 2022] DELETE /identity/v3/users/8c79fd10cc214eedaed558a0d47c8450 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:58.921948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:58.922233 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:58.922509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:58.942149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:58.943204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.004064 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1361/2715] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:59.014677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:59.021009 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.077460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511fd80-0dfa-40db-b954-31d6d19822d3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:59.081153 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:59.081755 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.082057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.082324 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.092393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:59.093892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:59.105264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1355/2716] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:59.531219 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:59.534002 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:59.546094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6bf0b-4fd4-4766-9635-93b32dec6026 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:59.551061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:59.551700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.552055 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.552678 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] PATH_INFO: `/v3/projects/ff93d13bad5f448882dea687f9cf0f7a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.553866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff93d13bad5f448882dea687f9cf0f7a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:59.555825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:59.704051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff93d13bad5f448882dea687f9cf0f7a', 'request_id': 'req-b969ca6f-3c42-4611-ba99-e54874c792f8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.822476 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff93d13bad5f448882dea687f9cf0f7a', 'request_id': 'req-b969ca6f-3c42-4611-ba99-e54874c792f8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.829917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff93d13bad5f448882dea687f9cf0f7a', 'request_id': 'req-b969ca6f-3c42-4611-ba99-e54874c792f8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.834461 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:59.843502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] The token cache is being invalidate because project ff93d13bad5f448882dea687f9cf0f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:59.843765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.844537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:59.846034 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1362/2717] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:59 2022] DELETE /identity/v3/projects/ff93d13bad5f448882dea687f9cf0f7a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:59.852265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:59.860701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9bf0-f229-4ef4-b07a-dc9fbec9574e service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:59.918109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:59.918776 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:59.919078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:59.919328 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] PATH_INFO: `/v3/users/7564141c722c4c679ac3d5203d106da6` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:59.920505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7564141c722c4c679ac3d5203d106da6)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:59.922421 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.088898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7564141c722c4c679ac3d5203d106da6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.089880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7564141c722c4c679ac3d5203d106da6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.099161 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7564141c722c4c679ac3d5203d106da6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.180235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7564141c722c4c679ac3d5203d106da6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.193967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7564141c722c4c679ac3d5203d106da6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.200918 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1356/2718] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:59 2022] DELETE /identity/v3/users/7564141c722c4c679ac3d5203d106da6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:00.613797 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.615286 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:00.628705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ca6f-3c42-4611-ba99-e54874c792f8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.686524 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.687155 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.687431 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.687699 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] PATH_INFO: `/v3/projects/cb765572879c4c0594eb8addff3525d2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.688916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb765572879c4c0594eb8addff3525d2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.690765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:00.795720 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb765572879c4c0594eb8addff3525d2', 'request_id': 'req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.888962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb765572879c4c0594eb8addff3525d2', 'request_id': 'req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.895844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb765572879c4c0594eb8addff3525d2', 'request_id': 'req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.908243 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] The token cache is being invalidate because project cb765572879c4c0594eb8addff3525d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:00.908534 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.909269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:00.910878 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1363/2719] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:00 2022] DELETE /identity/v3/projects/cb765572879c4c0594eb8addff3525d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:00.915064 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:00.916625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:00.932496 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e09-f7b1-4f87-a086-14ff636fbf75 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:00.951299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:00.990886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:00.991509 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:00.991806 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:00.992089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] PATH_INFO: `/v3/users/4ee86d7986b64d6383de9697efdcda42` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:00.993198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee86d7986b64d6383de9697efdcda42)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:00.995106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:01.268182 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee86d7986b64d6383de9697efdcda42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.268891 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee86d7986b64d6383de9697efdcda42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.276939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee86d7986b64d6383de9697efdcda42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.374637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee86d7986b64d6383de9697efdcda42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.401803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7f7ef66c-235f-483c-8081-b7936e4e9399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee86d7986b64d6383de9697efdcda42'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:01.412125 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1357/2720] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:00 2022] DELETE /identity/v3/users/4ee86d7986b64d6383de9697efdcda42 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:01.972321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:01.975062 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:01.986385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2c5ad-086c-4cfd-a382-f4d3cd73ca20 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.059232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.060823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.061030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.061298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] PATH_INFO: `/v3/projects/e9fac58949db473298d7674278231132` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.062407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9fac58949db473298d7674278231132)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.064623 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.153570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:02.171565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9fac58949db473298d7674278231132', 'request_id': 'req-46d24f79-edc8-4a33-a81d-412de4feb77b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.246612 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9fac58949db473298d7674278231132', 'request_id': 'req-46d24f79-edc8-4a33-a81d-412de4feb77b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.253662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9fac58949db473298d7674278231132', 'request_id': 'req-46d24f79-edc8-4a33-a81d-412de4feb77b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.264838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] The token cache is being invalidate because project e9fac58949db473298d7674278231132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:02.265126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.265786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-46d24f79-edc8-4a33-a81d-412de4feb77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:02.267320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1364/2721] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:01 2022] DELETE /identity/v3/projects/e9fac58949db473298d7674278231132 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:02.273217 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.273744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.273851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.299942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:02.301478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:02.369752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1358/2722] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:02.378496 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.378780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.379059 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.402770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:02.404826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:02.425621 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1365/2723] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:02.427053 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.438856 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2594f5-92ff-4137-9e7a-79668a2c821d None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.444121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.444717 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.444993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.445451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.446257 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:02.446558 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.448503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.467909 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1359/2724] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:48:02.472993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.483677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7afc-b751-423c-a6e7-f4d2a0863215 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.488887 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.489521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.489795 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.490063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.490695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.492950 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.609945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1366/2725] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:02 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:02.612252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.628244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fd90f-23d3-4d0c-8180-9a09d3a08ef1 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.671399 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:02.747889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.748635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.748914 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.749181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.749940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.752156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.850583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1360/2726] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:02 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:02.852013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.866274 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81405-baed-47b1-abc5-da9219002bfe admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.889117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.889117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.889117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.889117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.890280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.890280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.903705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1367/2727] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:02.908057 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.929912 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb73cc-8991-4549-ad6b-de06749dfa61 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.939370 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.940291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.940790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.941251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.942516 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.944840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df4f30-76cf-4ad1-ae88-049703f8b948 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.967063 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1361/2728] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:48:02.968521 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.983392 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f53ce-cd3b-418c-99a1-069723723707 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.992296 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.993671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.993671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.993671 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] PATH_INFO: `/v3/projects/9b0ad417b41a464587b6f540d55860e4/users/db8b178c69b04799924241164912720a/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.017946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ad417b41a464587b6f540d55860e4, user_id=db8b178c69b04799924241164912720a, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.021123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.104506 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1368/2729] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:02 2022] PUT /identity/v3/projects/9b0ad417b41a464587b6f540d55860e4/users/db8b178c69b04799924241164912720a/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:03.118954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.118954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.118954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.158971 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] MFA Rules not processed for user `db8b178c69b04799924241164912720a`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:03.161648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.252605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1362/2730] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:03.265131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.266849 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.342466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784635-c434-4d14-8b63-550e8792fb78 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.347434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.348088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.348400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.348672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.362028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.364187 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.376763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1369/2731] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:03.780433 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.782069 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.874105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c4e1-491e-41a9-86b7-46077bbed4db None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.880262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:03.882478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:03.883028 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:03.883537 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:03.885638 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.924316 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:03.973471 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:03.975873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:03.984248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:03.986813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:03.993512 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138425-8811-43b0-9492-23ed5e020ece service glance] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:03.997899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1363/2732] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:04.005825 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:04.006446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:04.006774 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:04.007172 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:04.009817 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:04.027403 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:04.043173 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:04.062178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1370/2733] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:09.608851 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:09.610365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.686390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fc42-d02b-44aa-b28c-6fffa16ed3e7 service nova] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:09.690029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:09.690616 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:09.690896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:09.691165 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:09.692979 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:09.780801 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:09.782699 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:09.794995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1364/2734] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:14.054772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=6,keystone:SELECT=73,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:17.701319 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:17.702884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:17.717101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7c602-c280-4aab-8abe-239d06b27d63 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:17.721883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:17.722504 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:17.722783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:17.723053 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] PATH_INFO: `/v3/users/2e7133f18b124c7f9605a83f855e9fc8` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:17.724206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7133f18b124c7f9605a83f855e9fc8)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:17.726163 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:17.885336 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7133f18b124c7f9605a83f855e9fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:17.886063 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7133f18b124c7f9605a83f855e9fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:17.899027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7133f18b124c7f9605a83f855e9fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:17.970674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7133f18b124c7f9605a83f855e9fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:17.977966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7133f18b124c7f9605a83f855e9fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:17.983983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1371/2735] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:17 2022] DELETE /identity/v3/users/2e7133f18b124c7f9605a83f855e9fc8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:18.212448 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:18.223575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689962-c7ae-4546-bcb3-0f23fa693473 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:18.283592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:18.284248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.284545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.284803 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] PATH_INFO: `/v3/projects/e9dffae44b954a54866772bcc4e9d60a` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.285910 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9dffae44b954a54866772bcc4e9d60a)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:18.287822 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:18.316337 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:18.425686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9dffae44b954a54866772bcc4e9d60a', 'request_id': 'req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.431945 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9dffae44b954a54866772bcc4e9d60a', 'request_id': 'req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.518879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9dffae44b954a54866772bcc4e9d60a', 'request_id': 'req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.530010 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] The token cache is being invalidate because project e9dffae44b954a54866772bcc4e9d60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:18.530297 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.530920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-4804cc7f-f26c-4fd2-bd40-0ba3e145f237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.532422 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1365/2736] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:18 2022] DELETE /identity/v3/projects/e9dffae44b954a54866772bcc4e9d60a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:18.536557 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:18.537998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.551709 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d305-f977-4f3b-86a7-ef2733d6ab7f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:18.610945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:18.611563 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.611862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.612131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] PATH_INFO: `/v3/users/9036f0ce6bd742e88bc91d4344716766` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.613375 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9036f0ce6bd742e88bc91d4344716766)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:18.615444 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:18.805858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9036f0ce6bd742e88bc91d4344716766'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.806590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9036f0ce6bd742e88bc91d4344716766'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.819620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9036f0ce6bd742e88bc91d4344716766'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.827332 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:18.827935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:18.828309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:18.847443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:18.850458 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:18.887759 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9036f0ce6bd742e88bc91d4344716766'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.890210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:18.895642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9036f0ce6bd742e88bc91d4344716766'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:18.902011 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1372/2737] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:18 2022] DELETE /identity/v3/users/9036f0ce6bd742e88bc91d4344716766 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:18.904703 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1366/2738] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:19.053096 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:19.054959 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:19.127450 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa3ec-9a6d-42fd-b7b3-5a655232d928 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:19.132607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:19.133208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:19.133481 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:19.133746 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:19.190802 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:19.192445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:19.201564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1373/2739] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:19.213122 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:19.215277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:19.237658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b2674-8225-4499-b82c-f732a5dca7e4 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:19.322134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:19.322942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:19.323334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:19.323714 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] PATH_INFO: `/v3/projects/05a5a5055aaf46fc987c600e05051b79` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:19.325384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a5a5055aaf46fc987c600e05051b79)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:19.327390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:19.434091 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a5a5055aaf46fc987c600e05051b79', 'request_id': 'req-cfd0c946-cc95-40b8-94af-c675c2305d4f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:19.442198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a5a5055aaf46fc987c600e05051b79', 'request_id': 'req-cfd0c946-cc95-40b8-94af-c675c2305d4f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:19.447113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:19.523981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a5a5055aaf46fc987c600e05051b79', 'request_id': 'req-cfd0c946-cc95-40b8-94af-c675c2305d4f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:19.543837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] The token cache is being invalidate because project 05a5a5055aaf46fc987c600e05051b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:19.543837 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:19.544940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-cfd0c946-cc95-40b8-94af-c675c2305d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:19.547049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1367/2740] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:19 2022] DELETE /identity/v3/projects/05a5a5055aaf46fc987c600e05051b79 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:29.197205 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=58 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:29.553023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:29.553941 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:29.663658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07f557-03ed-4727-945f-e2c3f50ee499 service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:29.738012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:29.738763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:29.739250 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:29.740132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] PATH_INFO: `/v3/users/db8b178c69b04799924241164912720a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:29.741346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8b178c69b04799924241164912720a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:29.743260 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:29.808523 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=4,keystone:DELETE=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:29.964367 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8b178c69b04799924241164912720a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:29.965082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8b178c69b04799924241164912720a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:29.985044 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8b178c69b04799924241164912720a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:30.056334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8b178c69b04799924241164912720a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:30.066232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8b178c69b04799924241164912720a'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:30.073493 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1374/2741] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:29 2022] DELETE /identity/v3/users/db8b178c69b04799924241164912720a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:30.079089 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:30.079379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:30.079802 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:30.139156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:30.141137 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:30.230698 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1368/2742] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:30.238446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:30.240465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:30.265811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:30.350007 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943452-00ec-40e8-b267-583ce0cac3bf admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:30.354542 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:30.355153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:30.355470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:30.355885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:30.367840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:30.369400 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d904d2-a877-4587-b0e8-a42cbe279d5a service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:30.391883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1375/2743] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:31.134987 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:31.137809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:31.168033 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733a409-b8dc-43b9-97e4-df9a3c80e6e1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:31.177809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:31.178536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:31.179059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:31.179575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] PATH_INFO: `/v3/projects/9b0ad417b41a464587b6f540d55860e4` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:31.181059 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0ad417b41a464587b6f540d55860e4)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:31.183662 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:31.337442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0ad417b41a464587b6f540d55860e4', 'request_id': 'req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:31.344780 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0ad417b41a464587b6f540d55860e4', 'request_id': 'req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:31.419334 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0ad417b41a464587b6f540d55860e4', 'request_id': 'req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:31.432379 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] The token cache is being invalidate because project 9b0ad417b41a464587b6f540d55860e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:31.432677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:31.433357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:31.435163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1369/2744] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:31 2022] DELETE /identity/v3/projects/9b0ad417b41a464587b6f540d55860e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:36.526416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:36.526905 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:36.527030 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:36.555667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:36.556832 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:36.619194 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1376/2745] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:36.632519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:36.633900 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:36.704591 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1292-d11c-4dd3-b16b-5d7d1602529d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:36.709507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:36.710113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:36.710390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:36.710661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:36.718729 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:36.720405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:36.728434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1370/2746] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:39.683325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:39.685584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:39.751687 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142fe77-6091-490e-88c6-bae253bd555d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:39.756317 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:39.756947 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:39.757925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:39.757925 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] PATH_INFO: `/v3/users/3605d0a709584776bbfb5db6b3e7e846` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:39.758692 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3605d0a709584776bbfb5db6b3e7e846)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:39.760658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:39.900837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:39.909094 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3605d0a709584776bbfb5db6b3e7e846'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:39.909748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3605d0a709584776bbfb5db6b3e7e846'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:39.921934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3605d0a709584776bbfb5db6b3e7e846'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:39.999415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3605d0a709584776bbfb5db6b3e7e846'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.006839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-05da60ce-fc84-44c3-86ac-6a5a4b89b642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3605d0a709584776bbfb5db6b3e7e846'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.012946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1377/2747] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:39 2022] DELETE /identity/v3/users/3605d0a709584776bbfb5db6b3e7e846 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:40.264588 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:40.275862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029820d-d1a5-4962-805f-019967ea9aeb service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:40.280225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:40.336313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:40.336871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:40.337151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:40.337519 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] PATH_INFO: `/v3/projects/e88ffbf9c625452cb950c3ee8ca023cf` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:40.338645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88ffbf9c625452cb950c3ee8ca023cf)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:40.340585 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:40.469194 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88ffbf9c625452cb950c3ee8ca023cf', 'request_id': 'req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.477264 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88ffbf9c625452cb950c3ee8ca023cf', 'request_id': 'req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.538964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88ffbf9c625452cb950c3ee8ca023cf', 'request_id': 'req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.550215 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] The token cache is being invalidate because project e88ffbf9c625452cb950c3ee8ca023cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:40.550506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.551203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-51e1a3d1-d7e7-4699-8d8e-32b0a8c5a954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:40.552831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1371/2748] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:40 2022] DELETE /identity/v3/projects/e88ffbf9c625452cb950c3ee8ca023cf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:40.558022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:40.558301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:40.558588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:40.612934 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:40.614150 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:40.672792 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1378/2749] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:40.734846 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:40.735127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:40.735420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:40.755686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:40.757004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:40.764811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1372/2750] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:40.768981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:40.779176 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890236-efbc-4bab-8c85-fbe7150203a4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:40.783903 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:40.784492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:40.784769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:40.785038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:40.785677 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:48:40.785976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:40.787556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:40.800509 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1379/2751] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:48:40.804696 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:40.813906 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9c55-844a-439c-96ac-4cf2c910be9c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:40.818625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:40.819221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:40.819495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:40.819761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:40.820424 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:40.822299 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:40.931517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1373/2752] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:40.935881 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:40.947000 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db23c4-d2b5-4edb-ae16-096ff0305bf9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.004626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.005228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.005510 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.005784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.006402 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.008438 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.102169 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1380/2753] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:40 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:41.106239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.117633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e38c1-f0c7-4aa7-973b-0d48d3879398 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.122416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.123152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.123430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.123697 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.124357 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.125934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.136468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1374/2754] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:41.140914 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.150920 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60f693-8919-4162-8a3d-d6df5ca6c76f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.156615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.157206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.157484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.157756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.158391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.160009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7bae4-ddf5-44f8-b39c-d34bd880ed8d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.161265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:41.171508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1381/2755] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:41.177617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.187989 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdd496-8dff-4bb3-b8fb-1a711fee5acb admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.192673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.193313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.193590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.193860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] PATH_INFO: `/v3/projects/85f62e0ab9794cd3b843acfabba1190f/users/970a70f1722040a8b9473b546aa2a7be/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.209514 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f62e0ab9794cd3b843acfabba1190f, user_id=970a70f1722040a8b9473b546aa2a7be, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.212333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.305030 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1375/2756] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:41 2022] PUT /identity/v3/projects/85f62e0ab9794cd3b843acfabba1190f/users/970a70f1722040a8b9473b546aa2a7be/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:41.310249 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f149-2171-4abd-b01b-9dd36b03ee67 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.310530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f149-2171-4abd-b01b-9dd36b03ee67 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.310830 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f149-2171-4abd-b01b-9dd36b03ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.331944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6508f149-2171-4abd-b01b-9dd36b03ee67 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:41.333166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6508f149-2171-4abd-b01b-9dd36b03ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:41.392475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1382/2757] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:41.402162 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.404605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:41.439112 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:41.460926 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c5bf-23b0-4025-a28d-6fe853510d43 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.465541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.466084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.469706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.469706 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.476365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.477791 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.487629 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1376/2758] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:46.538330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:46.538836 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:46.538958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:46.570752 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] MFA Rules not processed for user `970a70f1722040a8b9473b546aa2a7be`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:46.582022 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:46.652181 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1383/2759] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:48:46.657753 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:46.668326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8026-de6d-4517-874e-498086a8bc89 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:46.674139 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:46.674840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:46.675188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:46.675527 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:46.676262 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:46.678234 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:46.780163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1377/2760] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:48:46 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:48:46.781261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:46.798822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f4a41-2130-421d-bf38-ac7f09c59a45 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:46.865397 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:46.865924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:46.866203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:46.866475 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:46.867234 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:46.869197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:46.952705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1384/2761] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:48:46 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:48:46.956677 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:46.968586 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15503-5dec-41b6-b6fa-7d89c98a50ce admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:46.973405 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:46.985868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:46.985868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:46.985868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:46.985868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:46.985868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:46.992397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1378/2762] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:46.993503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:47.005550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2550-6cd6-4c1a-ab0c-57e5d7f34762 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:47.011503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:47.012489 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:47.012839 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:47.013223 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] PATH_INFO: `/v3/projects/509bc3a9617640d28444dacb8ef92c8c/users/3ded831fe7f94e7ebc104b3c0cef4929/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:47.027377 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:47.031484 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=509bc3a9617640d28444dacb8ef92c8c, user_id=3ded831fe7f94e7ebc104b3c0cef4929, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:47.035758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:47.114298 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1385/2763] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:46 2022] PUT /identity/v3/projects/509bc3a9617640d28444dacb8ef92c8c/users/3ded831fe7f94e7ebc104b3c0cef4929/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:48:47.118475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:47.129202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eccec8-2dfc-493c-8d9e-8907e19ba767 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:47.187625 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:47.188266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:47.188546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:47.188816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:47.189460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:47.191054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a47b8-1110-4bd9-bd60-8b68cb5acbac admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:47.201899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1379/2764] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:48:47.206014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:47.216821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb906-dc2a-4a58-bd15-77add61bf24c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:47.221892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:47.222556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:47.222831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:47.223101 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] PATH_INFO: `/v3/projects/509bc3a9617640d28444dacb8ef92c8c/users/3ded831fe7f94e7ebc104b3c0cef4929/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:47.225065 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=509bc3a9617640d28444dacb8ef92c8c, user_id=3ded831fe7f94e7ebc104b3c0cef4929, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:47.227740 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:47.239445 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1386/2765] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:48:47 2022] PUT /identity/v3/projects/509bc3a9617640d28444dacb8ef92c8c/users/3ded831fe7f94e7ebc104b3c0cef4929/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:52.654745 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c08d-ded4-4a3d-ad78-1150b3c30e0a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:52.655225 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c08d-ded4-4a3d-ad78-1150b3c30e0a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:52.655452 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9c08d-ded4-4a3d-ad78-1150b3c30e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:52.688939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9dc9c08d-ded4-4a3d-ad78-1150b3c30e0a None None] MFA Rules not processed for user `3ded831fe7f94e7ebc104b3c0cef4929`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:52.690272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9dc9c08d-ded4-4a3d-ad78-1150b3c30e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:52.783320 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1380/2766] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:48:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:52.801003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:52.802829 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:52.874858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d54f1d-e24a-40a2-88c1-fba3c3b81c2b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:52.879017 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b0a6b75badb4d04a7d32044d2d61af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:52.879643 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:52.879982 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:52.880339 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:52.945975 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:52.947482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:52.958453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1387/2767] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:53.251411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:53.251694 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:53.252000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:53.272133 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:53.274545 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:53.292356 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.336639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1381/2768] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:53.350632 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:53.352105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:53.424015 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af18b2-6aec-42dc-886f-9354d3d00fec service glance] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:53.429167 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:53.429705 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:53.429981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:53.430254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:53.439086 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:53.440743 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0451-7a07-4ba5-aada-d02ec6b9231f service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:53.449078 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1388/2769] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:57.343482 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:57.344956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:57.538997 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020552-a3cb-46c1-87fc-b52be602c75c None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:57.552219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:57.552867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:57.553149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:57.553416 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:57.555440 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:57.580232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:57.581873 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d81d8-67bd-4aee-8e42-991a9bde15c9 service placement] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:57.600412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1382/2770] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:02.886289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577c33-f0ae-4f01-b530-3133fb9035c2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:02.896786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577c33-f0ae-4f01-b530-3133fb9035c2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:02.896786 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee577c33-f0ae-4f01-b530-3133fb9035c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:02.908095 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ee577c33-f0ae-4f01-b530-3133fb9035c2 None None] MFA Rules not processed for user `5d9672843107418cab4f0a1be39593c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:02.909109 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ee577c33-f0ae-4f01-b530-3133fb9035c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:02.928320 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:02.973035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1389/2771] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:49:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:04.288068 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868572-2858-4f4c-b14c-142989317858 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:04.288578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868572-2858-4f4c-b14c-142989317858 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:04.288701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9868572-2858-4f4c-b14c-142989317858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:04.313464 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d9868572-2858-4f4c-b14c-142989317858 None None] MFA Rules not processed for user `970a70f1722040a8b9473b546aa2a7be`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:04.314653 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d9868572-2858-4f4c-b14c-142989317858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:04.321948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1383/2772] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:49:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:07.932058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:07.932868 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:07.933346 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:07.955718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:07.957242 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:07.964729 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1390/2773] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 24 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:07.979390 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9868572-2858-4f4c-b14c-142989317858 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:07.993116 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9868572-2858-4f4c-b14c-142989317858 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:07.999058 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:07.999658 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:07.999977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:08.000249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:08.008528 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:08.010114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:08.019218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1384/2774] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:49:17.949452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=18 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:18.015969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=64 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:31.163344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:31.226337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00fe8-763d-4629-8f23-ffe9350061d0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:31.230001 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:31.230603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:31.230890 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:31.231166 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:31.240337 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:31.241852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:31.251945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1391/2775] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:41.247083 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=30 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:35.311141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:35.312718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:35.383597 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e817a-5e28-4d21-bfde-6f0df27d9c80 service swift] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:35.389077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:35.389744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:35.390025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:35.390311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] PATH_INFO: `/v3/users/5d9672843107418cab4f0a1be39593c7` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:35.391431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9672843107418cab4f0a1be39593c7)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:35.393371 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:35.620536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9672843107418cab4f0a1be39593c7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:35.621181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9672843107418cab4f0a1be39593c7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:35.628451 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9672843107418cab4f0a1be39593c7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:35.701977 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9672843107418cab4f0a1be39593c7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:35.714670 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f83e8fdf-1bad-4bbe-8fec-d38583bdca53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9672843107418cab4f0a1be39593c7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:35.720598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1385/2776] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:35 2022] DELETE /identity/v3/users/5d9672843107418cab4f0a1be39593c7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:35.952321 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:35.962954 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5902e-1e7f-4829-9ecf-dff0b675ed55 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.019686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.020340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.020619 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.020892 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] PATH_INFO: `/v3/projects/8e8ed1e2c0124f90adfed9f4c13c7755` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.021991 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8ed1e2c0124f90adfed9f4c13c7755)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.023916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.160814 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8ed1e2c0124f90adfed9f4c13c7755', 'request_id': 'req-3159fa69-2f01-41c6-990c-7e6e41beeb6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:36.218876 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8ed1e2c0124f90adfed9f4c13c7755', 'request_id': 'req-3159fa69-2f01-41c6-990c-7e6e41beeb6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:36.226313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8ed1e2c0124f90adfed9f4c13c7755', 'request_id': 'req-3159fa69-2f01-41c6-990c-7e6e41beeb6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:36.237409 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] The token cache is being invalidate because project 8e8ed1e2c0124f90adfed9f4c13c7755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:36.237693 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:36.238324 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3159fa69-2f01-41c6-990c-7e6e41beeb6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:36.239824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1392/2777] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:35 2022] DELETE /identity/v3/projects/8e8ed1e2c0124f90adfed9f4c13c7755 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:36.244848 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.245156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.245434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.266396 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:36.267600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:36.329770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1386/2778] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:36.338386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.339332 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.339514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.359736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:36.360904 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:36.368717 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1393/2779] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:36.373012 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.382702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4930-cda9-4010-9e22-07ba9bd82e3a None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.387236 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.387831 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.388108 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.388368 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.389007 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:50:36.389296 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.390875 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.403177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1387/2780] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:50:36.407502 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.417584 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e5a8-c138-438e-998c-2d15be12248f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.422334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.422924 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.423202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.423473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.424145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.426066 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.507404 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1394/2781] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:36 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:36.511921 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.522191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa7ba-fb18-4ad7-a80b-c5934162193f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.525807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:36.578953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.579613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.579917 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.580232 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.580946 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.583015 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.671506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1388/2782] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:36 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:36.675826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.686364 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cadd-aaa2-4e62-9fe3-c8f6e301abab admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.690997 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.691603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.691929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.692203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.692842 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.694441 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.705206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1395/2783] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:36.709146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.719663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0021d5-e996-4517-bf0c-6c5063b7f644 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.724819 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.725400 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.725733 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.725947 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.726578 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.728191 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be85cb-9651-419e-850a-5a9b77dd1875 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.738031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1389/2784] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:50:36.742196 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.752460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8478-d272-48ef-a017-e61f15192a90 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:36.757209 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:36.757856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.758161 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.758434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] PATH_INFO: `/v3/projects/28d53150c4c44067b8f30f9707b3a862/users/d7499d4f07494909b1cfd98079b95a80/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.774146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d53150c4c44067b8f30f9707b3a862, user_id=d7499d4f07494909b1cfd98079b95a80, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:36.777877 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:36.856070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1396/2785] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:36 2022] PUT /identity/v3/projects/28d53150c4c44067b8f30f9707b3a862/users/d7499d4f07494909b1cfd98079b95a80/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:36.866437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28164-ea53-4647-a000-35b887b59548 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:36.866723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28164-ea53-4647-a000-35b887b59548 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:36.866999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28164-ea53-4647-a000-35b887b59548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:36.895692 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-fec28164-ea53-4647-a000-35b887b59548 None None] MFA Rules not processed for user `d7499d4f07494909b1cfd98079b95a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:36.896940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fec28164-ea53-4647-a000-35b887b59548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:36.962066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1390/2786] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:36.973863 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:36.975646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:36.998854 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:37.071767 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae588d-0ea8-4449-b2eb-9e043153a4d8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:37.078398 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:37.078998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:37.079278 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:37.079556 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:37.088314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:37.090088 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:37.099009 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1397/2787] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:38.832143 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28164-ea53-4647-a000-35b887b59548 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:38.833554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-fec28164-ea53-4647-a000-35b887b59548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:38.913231 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28164-ea53-4647-a000-35b887b59548 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:38.916929 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:38.917536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:38.917813 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:38.918087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:38.919863 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:38.933598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:38.935021 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489d00-6104-4dd1-b76b-bb116378776a service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:38.939730 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:38.946486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1391/2788] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:40.284704 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:40.346429 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2753-d335-4dda-aff4-334263eb72b3 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:40.350855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:40.351465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:40.351739 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:40.352043 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] PATH_INFO: `/v3/users/d7499d4f07494909b1cfd98079b95a80` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:40.353132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7499d4f07494909b1cfd98079b95a80)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:40.355732 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:40.534021 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7499d4f07494909b1cfd98079b95a80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:40.534681 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7499d4f07494909b1cfd98079b95a80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:40.546711 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7499d4f07494909b1cfd98079b95a80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:40.627715 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7499d4f07494909b1cfd98079b95a80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:40.634983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7499d4f07494909b1cfd98079b95a80'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:40.641575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1398/2789] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:40 2022] DELETE /identity/v3/users/d7499d4f07494909b1cfd98079b95a80 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:40.646193 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538887-db86-409f-83bf-939227eedcd5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:40.646668 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538887-db86-409f-83bf-939227eedcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:40.646782 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538887-db86-409f-83bf-939227eedcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:40.667408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-13538887-db86-409f-83bf-939227eedcd5 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:40.668635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-13538887-db86-409f-83bf-939227eedcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:40.727082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1392/2790] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:40.737027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:40.738413 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:40.742309 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:40.810191 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5e91-effd-4432-999b-22d1f01f9e77 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:40.813864 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:40.814505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:40.814812 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:40.815071 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:40.825566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:40.826995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f5c4-37ce-4016-bbe7-17a3aeda9cdf service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:40.837131 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1399/2791] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:41.299128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13538887-db86-409f-83bf-939227eedcd5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.299128 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-13538887-db86-409f-83bf-939227eedcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.311983 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13538887-db86-409f-83bf-939227eedcd5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.316168 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.316886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.317235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.317598 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] PATH_INFO: `/v3/projects/28d53150c4c44067b8f30f9707b3a862` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.319318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d53150c4c44067b8f30f9707b3a862)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.321486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:41.459580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d53150c4c44067b8f30f9707b3a862', 'request_id': 'req-30d292a9-2fff-409b-93db-24032cf1193d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:41.466621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d53150c4c44067b8f30f9707b3a862', 'request_id': 'req-30d292a9-2fff-409b-93db-24032cf1193d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:41.548712 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d53150c4c44067b8f30f9707b3a862', 'request_id': 'req-30d292a9-2fff-409b-93db-24032cf1193d'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:41.561583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] The token cache is being invalidate because project 28d53150c4c44067b8f30f9707b3a862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:41.561866 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:41.562607 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-30d292a9-2fff-409b-93db-24032cf1193d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:41.564082 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1393/2792] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:41 2022] DELETE /identity/v3/projects/28d53150c4c44067b8f30f9707b3a862 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:41.569061 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.569555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.569748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.590460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:41.591661 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.649703 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1400/2793] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:41.658503 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.659006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.659121 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.679294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:41.680525 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:41.688690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1394/2794] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:41.692869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.702785 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158523a-3b5b-4d8e-b595-4eacb92dd0da None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.707314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.707945 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.708208 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.708477 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.709111 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:50:41.709411 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.710993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:41.722909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1401/2795] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:50:41.727104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.737034 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a629-fbc4-4779-9117-1264847261cf None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.741666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.742252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.742531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.742800 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.743417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.745494 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:41.829304 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1395/2796] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:41 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:41.833394 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.844165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c542a-85d9-42db-a89f-1398688a576b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.901708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.902305 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.902583 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.902852 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.903473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.905436 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:41.971654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1402/2797] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:41 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:41.975760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:41.985986 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd514-c594-4aa4-abaf-2931fe158b59 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:41.990764 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:41.991351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:41.991621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:41.991963 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:41.992605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:41.994202 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:42.004141 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1396/2798] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:42.008179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:42.019049 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7135-f006-4611-aff1-b88cac017e64 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:42.023685 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:42.024302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:42.024579 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:42.024855 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:42.025480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:42.027679 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8710b18-8c49-4b1f-8b2b-046fba82616d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:42.032918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:42.038547 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1403/2799] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:42.047352 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:42.057308 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f73d-ac72-4ad6-992f-052a2a80b7f3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:42.062111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:42.062749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:42.063025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:42.063294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] PATH_INFO: `/v3/projects/0618bf52861f4a0c8437f482770de2d6/users/e7632b436ea34dbf9f1ed6542fbba87e/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:42.078898 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0618bf52861f4a0c8437f482770de2d6, user_id=e7632b436ea34dbf9f1ed6542fbba87e, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:42.081628 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:42.156860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1397/2800] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:42 2022] PUT /identity/v3/projects/0618bf52861f4a0c8437f482770de2d6/users/e7632b436ea34dbf9f1ed6542fbba87e/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:42.162028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3793-9c4c-474c-bf89-d536e2e5fa8c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:42.162313 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3793-9c4c-474c-bf89-d536e2e5fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:42.162589 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3793-9c4c-474c-bf89-d536e2e5fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:42.181014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c0bc3793-9c4c-474c-bf89-d536e2e5fa8c None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:42.182227 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c0bc3793-9c4c-474c-bf89-d536e2e5fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:42.240241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1404/2801] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:42.250622 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:42.252369 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:42.273315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:42.311252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e44c8-5c96-434a-8f95-815f2affefe2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:42.314995 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:42.317025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:42.317025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:42.317025 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:42.326417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:42.327892 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:42.337441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1398/2802] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:43.545352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:43.553038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:43.553038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:43.579391 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] MFA Rules not processed for user `e7632b436ea34dbf9f1ed6542fbba87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:43.581102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:43.648826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1405/2803] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:43.653417 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:43.663052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90d7ad-0cdd-40a5-b920-6a8ddb5e6713 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:43.668292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:43.668878 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:43.669152 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:43.669419 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:43.670031 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:43.671961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:43.743365 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1399/2804] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:43 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:43.747410 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:43.758129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94272c3-b182-4073-9387-28855fe6dcce None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:43.813962 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:43.814488 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:43.814763 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:43.815032 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:43.815655 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:43.817596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:43.927576 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1406/2805] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:43 2022] POST /identity/v3/users => generated 309 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:43.931536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:43.942411 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3063-1e4c-4140-b094-6ead97619a9f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:43.947412 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:43.948226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:43.948719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:43.948991 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:43.949633 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:43.951233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:43.961953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1400/2806] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:43.966784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:43.976779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13883e13-62e7-4d65-a4d3-0a21cb09d22e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:43.982197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:43.982840 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:43.983121 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:43.983393 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] PATH_INFO: `/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78/users/88b99e1c8b5b48b6aebe4692792a8040/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:43.997981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1f5abca66944bf801d6e7b1fd67e78, user_id=88b99e1c8b5b48b6aebe4692792a8040, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:44.000654 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:44.003648 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:44.093483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1407/2807] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:43 2022] PUT /identity/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78/users/88b99e1c8b5b48b6aebe4692792a8040/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:44.097432 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:44.108134 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bdf09-46a6-4391-b59d-3752958fb9a3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:44.164695 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:44.165292 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:44.165569 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:44.165854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:44.166486 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:44.168233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf768-b48e-4048-a9f4-a32a50e81a9c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:44.177844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1401/2808] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:44.182028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:44.192443 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cfac6-701a-4bdb-a89a-5f6d7e097ec9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:44.196992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:44.198533 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:44.198808 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:44.199077 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] PATH_INFO: `/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78/users/88b99e1c8b5b48b6aebe4692792a8040/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:44.200996 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1f5abca66944bf801d6e7b1fd67e78, user_id=88b99e1c8b5b48b6aebe4692792a8040, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:44.203598 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:44.214662 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1408/2809] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:44 2022] PUT /identity/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78/users/88b99e1c8b5b48b6aebe4692792a8040/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:45.630744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:45.631219 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:45.631484 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:45.661689 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] MFA Rules not processed for user `88b99e1c8b5b48b6aebe4692792a8040`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:45.662916 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:45.734294 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1402/2810] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:46.899149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:46.900967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:46.974405 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9e3c-b319-47ac-80b0-a10b438fddbd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:46.979453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:46.980843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:46.981340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:46.981600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:46.983354 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:46.994843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:46.997054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:47.007255 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1409/2811] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:47.039251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:47.050129 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:47.103723 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2d3e4-9c06-4bf8-b7b7-7eac34829dd3 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:47.109127 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:47.109762 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:47.110039 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:47.110309 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] PATH_INFO: `/v3/users/e7632b436ea34dbf9f1ed6542fbba87e` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:47.111434 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7632b436ea34dbf9f1ed6542fbba87e)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:47.113430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:47.344596 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7632b436ea34dbf9f1ed6542fbba87e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.345321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7632b436ea34dbf9f1ed6542fbba87e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.352189 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7632b436ea34dbf9f1ed6542fbba87e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.419322 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7632b436ea34dbf9f1ed6542fbba87e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.435738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7632b436ea34dbf9f1ed6542fbba87e'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.442044 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1403/2812] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:47 2022] DELETE /identity/v3/users/e7632b436ea34dbf9f1ed6542fbba87e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:47.698708 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:47.709970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81d9a3-e388-49fc-961c-ea77d46ec136 service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:47.768652 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:47.769277 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:47.769555 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:47.769827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] PATH_INFO: `/v3/projects/0618bf52861f4a0c8437f482770de2d6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:47.770933 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0618bf52861f4a0c8437f482770de2d6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:47.772871 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:47.887762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0618bf52861f4a0c8437f482770de2d6', 'request_id': 'req-e548b34e-173e-4361-9caa-bd8104be579c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.955603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0618bf52861f4a0c8437f482770de2d6', 'request_id': 'req-e548b34e-173e-4361-9caa-bd8104be579c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.962098 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0618bf52861f4a0c8437f482770de2d6', 'request_id': 'req-e548b34e-173e-4361-9caa-bd8104be579c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.973470 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] The token cache is being invalidate because project 0618bf52861f4a0c8437f482770de2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:47.973762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.974399 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:47.975913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1410/2813] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:47 2022] DELETE /identity/v3/projects/0618bf52861f4a0c8437f482770de2d6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:47.979936 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:47.981339 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:47.994375 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702cc5-28ec-4318-aeea-7f425642a0f0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:48.051939 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:48.052619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:48.052841 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:48.053106 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] PATH_INFO: `/v3/users/88b99e1c8b5b48b6aebe4692792a8040` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:48.054221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b99e1c8b5b48b6aebe4692792a8040)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:48.056150 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:48.193385 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:48.207329 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b99e1c8b5b48b6aebe4692792a8040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.208035 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b99e1c8b5b48b6aebe4692792a8040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.215507 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b99e1c8b5b48b6aebe4692792a8040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.269611 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b99e1c8b5b48b6aebe4692792a8040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.282078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-52c2ee8b-ac60-44d6-9a86-6203e2f53223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b99e1c8b5b48b6aebe4692792a8040'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.288052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1404/2814] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:47 2022] DELETE /identity/v3/users/88b99e1c8b5b48b6aebe4692792a8040 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:48.598156 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:48.599590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:48.607615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:48.613396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b34e-173e-4361-9caa-bd8104be579c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:48.671921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:48.672550 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:48.672823 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:48.673089 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] PATH_INFO: `/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:48.674206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1f5abca66944bf801d6e7b1fd67e78)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:48.676093 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:48.819158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1f5abca66944bf801d6e7b1fd67e78', 'request_id': 'req-5d7e7166-477b-4952-9096-4f7da7a0c028'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.909929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1f5abca66944bf801d6e7b1fd67e78', 'request_id': 'req-5d7e7166-477b-4952-9096-4f7da7a0c028'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.916537 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1f5abca66944bf801d6e7b1fd67e78', 'request_id': 'req-5d7e7166-477b-4952-9096-4f7da7a0c028'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.927529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] The token cache is being invalidate because project ab1f5abca66944bf801d6e7b1fd67e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:48.927858 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.928483 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5d7e7166-477b-4952-9096-4f7da7a0c028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:48.929968 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1411/2815] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:48 2022] DELETE /identity/v3/projects/ab1f5abca66944bf801d6e7b1fd67e78 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:48.935688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048194-223c-4514-98c2-28d4063b1cee None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:48.936001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048194-223c-4514-98c2-28d4063b1cee None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:48.936270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048194-223c-4514-98c2-28d4063b1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:48.956639 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-75048194-223c-4514-98c2-28d4063b1cee None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:48.957844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-75048194-223c-4514-98c2-28d4063b1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:49.020656 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1405/2816] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:49.028917 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.029419 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.029530 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.050099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:49.051334 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:49.059327 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1412/2817] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:49.063479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048194-223c-4514-98c2-28d4063b1cee None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.073447 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048194-223c-4514-98c2-28d4063b1cee None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.078026 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.078621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.078901 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.079169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.079855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:50:49.080169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.081832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.094190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1406/2818] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:50:49.098770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.108674 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715d8a-7880-4df4-98d9-3db05739f97d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.113529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.114154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.114427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.114695 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.115315 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.117284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.261806 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1413/2819] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:49.265006 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.274957 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24858-f6cc-4b37-ab7a-c5b54b5db17b admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.334224 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.334823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.335104 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.335373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.336020 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.337984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.436495 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1407/2820] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:49.440577 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.451816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3371-d382-475a-b962-d3291e6a9247 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.456407 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.457051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.457335 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.457586 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.458241 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.459856 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.470770 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1414/2821] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:49.474648 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.484647 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584e2c-042d-4b07-a0a7-bb4595e4d083 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.489151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.489747 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.490001 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.490268 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.490896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.492515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e4032-e121-43ba-8cfa-a76eb2163b7a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.503011 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1408/2822] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:49.507153 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.518031 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1d330-c78f-48e7-a70c-3cc08dda5066 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.522756 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.523401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.523843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.524123 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] PATH_INFO: `/v3/projects/067197fd5677469e83a3e91123f06934/users/9297d2994bff469a8b1ea09a731bcd0c/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.539079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067197fd5677469e83a3e91123f06934, user_id=9297d2994bff469a8b1ea09a731bcd0c, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.541755 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.647214 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1415/2823] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:49 2022] PUT /identity/v3/projects/067197fd5677469e83a3e91123f06934/users/9297d2994bff469a8b1ea09a731bcd0c/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:49.659138 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.667894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.667894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.685256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:49.688090 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] MFA Rules not processed for user `9297d2994bff469a8b1ea09a731bcd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:49.689280 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:49.753477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1409/2824] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:49.757970 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.789395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:49.819994 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d616-2269-4eb6-8b20-02af53ea2021 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.825135 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.825727 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.826003 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.826269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.826886 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.828929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:49.920418 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1416/2825] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:49.924442 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:49.935123 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d98c-8577-47b8-877b-5dbbfddfde31 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:49.991250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:49.991879 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:49.992159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:49.992429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:49.993041 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:49.994948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.091941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1410/2826] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:50:49 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:50:50.095716 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.106416 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c0c-a0b1-4d3e-8193-9ed7f45baa10 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.110937 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.111588 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.112051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.112189 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.112784 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.114368 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.124620 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1417/2827] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:50.128964 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.139871 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd2224-51e2-409e-b602-b8c3de4ebec5 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.144479 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.145120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.145395 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.145761 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] PATH_INFO: `/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22/users/f5507387366a46a0a650a1e3f5429839/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.160948 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d6b205eb7461795f4b6a8f93afa22, user_id=f5507387366a46a0a650a1e3f5429839, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.163590 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.238728 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1411/2828] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:50 2022] PUT /identity/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22/users/f5507387366a46a0a650a1e3f5429839/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:50.242645 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.253373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dfe8a-19d2-4da6-bff7-0cb77e8f610a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.313259 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.313869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.314149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.314427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.315070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.316702 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3819c7b-4b68-4ed2-8dcc-7b2f13733c27 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.327607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1418/2829] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:50:50.332066 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.342661 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530ec00-1ef8-4aac-a3c6-a28ba7b86fa0 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.347151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.347807 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.348075 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.348340 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] PATH_INFO: `/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22/users/f5507387366a46a0a650a1e3f5429839/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.350227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d6b205eb7461795f4b6a8f93afa22, user_id=f5507387366a46a0a650a1e3f5429839, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.352868 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.363571 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1412/2830] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:50:50 2022] PUT /identity/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22/users/f5507387366a46a0a650a1e3f5429839/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:50.374284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.374570 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.374843 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.402265 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] MFA Rules not processed for user `f5507387366a46a0a650a1e3f5429839`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:50.403498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:50.473338 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1419/2831] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:50.485786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:50.487744 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:50.548207 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256d093-6b47-4917-a0f4-4bd0ba209697 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:50.551954 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:50.552555 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:50.552832 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:50.553101 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:50.562060 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:50.610667 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:50.612052 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:50.621876 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1413/2832] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:52.271736 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:52.273154 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:52.285427 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd596e2-7b24-41d3-9bd9-518b06b81810 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:52.288963 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:52.289560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:52.289838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:52.290110 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:52.300434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:52.301867 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b23eab-1e0e-438a-bd9d-ed9d3d8f804a service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:52.312672 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1420/2833] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:56.536140 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:56.615931 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff939-89a3-40aa-81ac-145a075df805 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:56.621428 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:56.622179 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:56.622441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:56.622820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] PATH_INFO: `/v3/users/9297d2994bff469a8b1ea09a731bcd0c` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:56.624056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9297d2994bff469a8b1ea09a731bcd0c)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:56.626506 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:56.851266 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9297d2994bff469a8b1ea09a731bcd0c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:56.853719 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9297d2994bff469a8b1ea09a731bcd0c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:56.874799 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9297d2994bff469a8b1ea09a731bcd0c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:56.947511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9297d2994bff469a8b1ea09a731bcd0c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:56.965093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9297d2994bff469a8b1ea09a731bcd0c'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:56.976792 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1414/2834] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:56 2022] DELETE /identity/v3/users/9297d2994bff469a8b1ea09a731bcd0c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:56.978449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:56.978916 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:56.979084 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:56.998710 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:57.000210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:57.006967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:57.070198 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1421/2835] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:57.105704 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:57.108313 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:57.148430 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:57.175942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07e5f-77af-4c9d-b2c1-1050206ccbda admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:57.180928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:57.180928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:57.180928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:57.180928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:57.190690 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:57.192164 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:57.202373 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1415/2836] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:58.088995 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:58.091232 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:58.111118 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2c62-9e5e-4b10-8286-8233426d376a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:58.120560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:58.122670 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:58.123206 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:58.123686 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] PATH_INFO: `/v3/projects/067197fd5677469e83a3e91123f06934` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:58.125124 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067197fd5677469e83a3e91123f06934)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:58.138888 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:58.259246 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067197fd5677469e83a3e91123f06934', 'request_id': 'req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.332986 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067197fd5677469e83a3e91123f06934', 'request_id': 'req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.339700 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067197fd5677469e83a3e91123f06934', 'request_id': 'req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.350919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] The token cache is being invalidate because project 067197fd5677469e83a3e91123f06934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:58.351203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.351913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.353426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1422/2837] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:58 2022] DELETE /identity/v3/projects/067197fd5677469e83a3e91123f06934 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:58.363195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:58.367812 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0482-015f-42db-89b3-d33bd133851d service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:58.430823 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:58.431254 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:58.431517 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:58.431973 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] PATH_INFO: `/v3/users/f5507387366a46a0a650a1e3f5429839` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:58.433270 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5507387366a46a0a650a1e3f5429839)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:58.435226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:58.733437 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5507387366a46a0a650a1e3f5429839'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.734132 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5507387366a46a0a650a1e3f5429839'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.741404 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5507387366a46a0a650a1e3f5429839'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.836735 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5507387366a46a0a650a1e3f5429839'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.859212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-f61c6794-d7dc-4849-b9ad-bad7ece9ec0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5507387366a46a0a650a1e3f5429839'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:58.867218 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1416/2838] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:58 2022] DELETE /identity/v3/users/f5507387366a46a0a650a1e3f5429839 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:59.460164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:59.461613 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:59.477568 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea70f8a-4535-460e-8d39-c77a0d2b17f3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:59.543966 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:59.545564 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:59.545918 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:59.546195 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] PATH_INFO: `/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:59.547983 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2d6b205eb7461795f4b6a8f93afa22)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:59.549909 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:59.668772 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:59.677165 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2d6b205eb7461795f4b6a8f93afa22', 'request_id': 'req-228e4965-aaac-4a86-9b42-1c24a99d1380'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:59.812948 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2d6b205eb7461795f4b6a8f93afa22', 'request_id': 'req-228e4965-aaac-4a86-9b42-1c24a99d1380'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:59.820190 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2d6b205eb7461795f4b6a8f93afa22', 'request_id': 'req-228e4965-aaac-4a86-9b42-1c24a99d1380'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:59.831885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] The token cache is being invalidate because project fd2d6b205eb7461795f4b6a8f93afa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:59.832178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:59.832831 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-228e4965-aaac-4a86-9b42-1c24a99d1380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:59.834386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1423/2839] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:59 2022] DELETE /identity/v3/projects/fd2d6b205eb7461795f4b6a8f93afa22 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:59.839288 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:59.839775 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:59.839894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:59.860291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:59.861493 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:59.908359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:59.923702 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1417/2840] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:59.931657 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793313e-70af-47f5-9435-3e788034cccd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:59.931980 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793313e-70af-47f5-9435-3e788034cccd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:59.932253 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793313e-70af-47f5-9435-3e788034cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:59.954434 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e793313e-70af-47f5-9435-3e788034cccd None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:59.955203 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e793313e-70af-47f5-9435-3e788034cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:59.963276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1424/2841] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:59.967664 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:59.977361 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca215a-5f22-4436-a283-7ca54bdc27e6 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:59.982988 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:59.983820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:59.984283 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:59.984937 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:59.985634 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:50:59.985967 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:59.987524 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.000238 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1418/2842] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:51:00.004573 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793313e-70af-47f5-9435-3e788034cccd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.014303 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793313e-70af-47f5-9435-3e788034cccd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.019230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.019846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.020128 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.020396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.021023 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.022911 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.158473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1425/2843] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:00.162923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.173351 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7e71-0a9d-495b-bf57-a7d42fa46588 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.229326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.229928 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.230203 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.230475 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.231899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.233825 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.353335 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1419/2844] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:51:00.358566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.368976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52012-15ca-49c6-9065-54eece6d0793 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.373813 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.374482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.374698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.374971 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.375604 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.377238 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.387777 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1426/2845] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:00.391896 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.402536 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71125fd2-d7cc-48f6-93b7-655e4e79c9d8 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.408056 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.408708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.408920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.409187 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.409836 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.411420 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ceb14-819b-4845-bbc2-6399356e044f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.422886 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1420/2846] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:00.427079 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.437603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0e0b9-73b0-43a4-bc5a-1c34727c987e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.442425 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.445691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.445691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.445691 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] PATH_INFO: `/v3/projects/a12b978c38a244129cf0c3691ad3e89b/users/53d2f0eaf47b4564be823b9c487e7da7/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.459473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12b978c38a244129cf0c3691ad3e89b, user_id=53d2f0eaf47b4564be823b9c487e7da7, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.462117 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.545067 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1427/2847] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:00 2022] PUT /identity/v3/projects/a12b978c38a244129cf0c3691ad3e89b/users/53d2f0eaf47b4564be823b9c487e7da7/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:00.611844 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.612113 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.612383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.640687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] MFA Rules not processed for user `53d2f0eaf47b4564be823b9c487e7da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:00.641901 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.707241 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1421/2848] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:00.711735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.773676 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33cd5-2515-4aa5-8cae-20a35de3e4a2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.779211 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.779826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.780116 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.780385 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.781005 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.782902 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.853748 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1428/2849] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/projects => generated 399 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:00.858077 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.869000 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfc6a7-9219-4d34-a003-8859f79317fe None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.912564 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:00.925080 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.925682 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.925960 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.926235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.926860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.928809 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.039398 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1422/2850] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:00 2022] POST /identity/v3/users => generated 306 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:01.040593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.050783 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399070-ba1b-4cf3-95dc-c36c7dd4f330 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.055415 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.056047 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.056323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.056592 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.057222 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.058803 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.070041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1429/2851] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:01.074687 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.085570 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ecd8-3e2c-4949-9b8d-5fc54a99a892 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.090317 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.091198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.091478 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.091754 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] PATH_INFO: `/v3/projects/c4361346785649b2aab1b13a509b5377/users/cb26afb1eeba4dbf9c187d1e13c364c6/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.108460 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4361346785649b2aab1b13a509b5377, user_id=cb26afb1eeba4dbf9c187d1e13c364c6, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.111199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.235716 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1423/2852] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:01 2022] PUT /identity/v3/projects/c4361346785649b2aab1b13a509b5377/users/cb26afb1eeba4dbf9c187d1e13c364c6/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:01.239707 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.250426 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c8ce-1b39-4ae8-b5fe-97883bb3db72 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.292651 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:01.318421 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.319027 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.319306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.319575 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.320254 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.322105 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf58d8-7a5c-4e17-a59b-28587cd3086d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.332164 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1430/2853] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:01.336541 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.348022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1927d-97ae-4564-bcaa-723078a83973 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.352999 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.353654 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.353941 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.354212 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] PATH_INFO: `/v3/projects/c4361346785649b2aab1b13a509b5377/users/cb26afb1eeba4dbf9c187d1e13c364c6/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.357100 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4361346785649b2aab1b13a509b5377, user_id=cb26afb1eeba4dbf9c187d1e13c364c6, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.359858 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.370760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1424/2854] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:01 2022] PUT /identity/v3/projects/c4361346785649b2aab1b13a509b5377/users/cb26afb1eeba4dbf9c187d1e13c364c6/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:01.388520 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.388805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.389082 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.417473 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] MFA Rules not processed for user `cb26afb1eeba4dbf9c187d1e13c364c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:01.419628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:01.490921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1431/2855] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:01.502741 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.508605 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:01.566401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7579e-e77e-4f25-91a3-00c6190c823f admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.571533 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.572431 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.572709 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.572975 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.582181 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.583609 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.593195 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1425/2856] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:51:01.792883 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:01.803236 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a84da1-20fe-4087-85a3-0cbff006288d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:01.806896 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:01.807486 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:01.807758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:01.808058 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:01.866762 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:01.868239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:01.877590 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1432/2857] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:02.584899 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:02.586326 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:02.643251 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e12935-15df-470d-a4b1-1454f1682cee service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:02.646865 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:02.647466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:02.647749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:02.648054 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:02.649786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:02.707163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:02.729429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:02.730958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf05f1-e3e5-4558-abae-4b617bb98be2 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:02.742956 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1426/2858] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:51:03.771465 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:03.772944 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:03.789508 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ce68-05c2-4bf8-ac34-bc8affce1071 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:03.795038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b0807da1ad345eb9de13973cae6bfd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:03.795628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:03.795940 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:03.796218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:03.797869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:03.811012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:03.811718 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:03.822866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1433/2859] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:05.165376 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:05.165861 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:05.165993 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:05.217119 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] MFA Rules not processed for user `bd93883307a1430bafdd32a91157f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:05.218359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:05.285707 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1427/2860] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 24 10:51:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:05.333070 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:05.334549 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:05.381517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:05.432218 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9038b-a055-40f5-ac7e-6806293acf52 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:05.439091 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21315db813dc407d8b0577065110be44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:05.439907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:05.440188 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:05.440459 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:05.449269 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:05.451452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493fbdb-e571-48b4-b94f-aabdf501d3b6 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:05.459880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1434/2861] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 24 10:51:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:51:07.082859 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:07.150894 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9411fa-ac85-4be2-9d2f-5b8712d418d1 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:07.156261 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:07.156920 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:07.157199 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:07.157468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] PATH_INFO: `/v3/users/53d2f0eaf47b4564be823b9c487e7da7` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:07.158621 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d2f0eaf47b4564be823b9c487e7da7)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:07.160673 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:07.320854 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d2f0eaf47b4564be823b9c487e7da7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:07.322403 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d2f0eaf47b4564be823b9c487e7da7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:07.330601 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d2f0eaf47b4564be823b9c487e7da7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:07.332642 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:07.407159 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d2f0eaf47b4564be823b9c487e7da7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:07.421940 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d2f0eaf47b4564be823b9c487e7da7'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:07.431599 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1428/2862] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:07 2022] DELETE /identity/v3/users/53d2f0eaf47b4564be823b9c487e7da7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:07.433440 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:07.433939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:07.435505 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:07.457225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:07.458452 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:07.529420 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1435/2863] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:07.539439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:07.540923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:07.612539 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998007-a71d-4781-831c-73168b0c8acf admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:07.616190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:07.616860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:07.617198 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:07.618397 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:07.628269 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:07.630249 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:07.641093 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1429/2864] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:08.103595 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:08.105453 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:08.127482 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deb45d-f64c-48f1-b280-c15750f56742 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:08.140675 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:08.141326 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:08.141607 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:08.141880 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] PATH_INFO: `/v3/projects/a12b978c38a244129cf0c3691ad3e89b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:08.143565 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12b978c38a244129cf0c3691ad3e89b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:08.145535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:08.271099 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12b978c38a244129cf0c3691ad3e89b', 'request_id': 'req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.344635 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12b978c38a244129cf0c3691ad3e89b', 'request_id': 'req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.355958 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12b978c38a244129cf0c3691ad3e89b', 'request_id': 'req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.368862 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] The token cache is being invalidate because project a12b978c38a244129cf0c3691ad3e89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:08.369148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.369801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.371517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1436/2865] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:08 2022] DELETE /identity/v3/projects/a12b978c38a244129cf0c3691ad3e89b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:08.376383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:08.386281 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8580-9eed-4787-81dc-32f4e682498d service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:08.447708 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:08.448391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:08.448666 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:08.448935 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] PATH_INFO: `/v3/users/cb26afb1eeba4dbf9c187d1e13c364c6` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:08.450439 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb26afb1eeba4dbf9c187d1e13c364c6)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:08.452718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:08.675505 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb26afb1eeba4dbf9c187d1e13c364c6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.676828 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb26afb1eeba4dbf9c187d1e13c364c6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.685829 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb26afb1eeba4dbf9c187d1e13c364c6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.761177 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb26afb1eeba4dbf9c187d1e13c364c6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.773552 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:08.775084 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-6074f8b7-4eb9-4cbd-91d7-4eeb6c0e705c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb26afb1eeba4dbf9c187d1e13c364c6'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:08.781613 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1430/2866] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:08 2022] DELETE /identity/v3/users/cb26afb1eeba4dbf9c187d1e13c364c6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:09.232742 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.234378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.253127 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907f14-b6f4-4636-8cf6-f53a0b452f4f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.318210 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:09.348280 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.348946 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.349225 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.349522 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] PATH_INFO: `/v3/projects/c4361346785649b2aab1b13a509b5377` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.350653 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4361346785649b2aab1b13a509b5377)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.352615 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:09.473306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4361346785649b2aab1b13a509b5377', 'request_id': 'req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:09.535939 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4361346785649b2aab1b13a509b5377', 'request_id': 'req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:09.543276 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4361346785649b2aab1b13a509b5377', 'request_id': 'req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:09.559460 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] The token cache is being invalidate because project c4361346785649b2aab1b13a509b5377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:09.560603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:09.561596 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-5851d935-4bc8-4d2f-bc0d-aaaa2957bb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:09.563824 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1437/2867] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:09 2022] DELETE /identity/v3/projects/c4361346785649b2aab1b13a509b5377 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:09.569306 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.569760 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.569969 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.596429 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:09.597657 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.674720 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1431/2868] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:09.683992 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.684151 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.684373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.709574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:09.709574 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.717698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1438/2869] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:09.723441 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.737724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d317-61ef-42c8-97b5-141f01a83643 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.743330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.744078 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.744474 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.744840 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.746204 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:51:09.746725 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.749508 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:09.762366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1432/2870] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:51:09.769148 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.777899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd0cce-9b23-48d7-878f-135f261a80d8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.783605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.784230 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.784503 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.784768 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.785396 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.787293 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:09.896930 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1439/2871] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:09.901163 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.913406 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa29a1-1f4d-4433-8aec-257b2b8d612a admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.989497 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.990111 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.996344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.996344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.996344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.996344 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.079907 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1433/2872] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:10.087967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.095650 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4685-820c-47bb-9235-bbc0b8f00c2b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.100401 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.100998 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.101275 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.101546 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.102184 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.103769 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.114628 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1440/2873] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:10.118752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.129626 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a67593-55b5-4eec-94df-cf41bedc58f2 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.134466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.135045 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.135318 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.135583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.136250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.138635 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b0c5-7fb5-42e9-a541-499287523c77 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.149196 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1434/2874] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:10.159302 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.169562 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971654f5-6aa4-4aa7-8c47-0899f646ed78 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.174228 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.174869 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.175146 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.175414 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] PATH_INFO: `/v3/projects/0adb08c986134123a1774243c0d3315c/users/c28878f982854287a172b0d522a4af0f/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.190560 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0adb08c986134123a1774243c0d3315c, user_id=c28878f982854287a172b0d522a4af0f, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.193226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.268921 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1441/2875] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:10 2022] PUT /identity/v3/projects/0adb08c986134123a1774243c0d3315c/users/c28878f982854287a172b0d522a4af0f/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:51:10.285580 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.285862 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.286131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.322250 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] MFA Rules not processed for user `c28878f982854287a172b0d522a4af0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:10.323511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:10.374443 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.391515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1435/2876] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:10.395981 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.460314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18d39-1b81-422d-a0f9-3d90beae147b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.465185 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.465811 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.466149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.466529 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.467159 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.469075 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.474844 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:10.572221 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1442/2877] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:10 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:51:10.577042 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.588222 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bffe5b-736e-409f-b50d-3c3a1915de97 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.647307 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.648102 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.648384 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.653857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.653857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.653857 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.736456 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1436/2878] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:10 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:10.740741 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.753050 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4478383-f0d8-4987-a7da-bc1a7f3f9450 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.757765 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.758369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.758642 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.758908 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.759600 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.761226 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.772779 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1443/2879] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:10.777087 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.787889 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973324-e955-4f13-8b4c-0ff979936562 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.792724 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.793363 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.793637 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.794097 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] PATH_INFO: `/v3/projects/cd6aa7f793c44d1492c164c52b9685e0/users/aae1dfdd4ab94a4d8ddad0961428cd06/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.809277 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6aa7f793c44d1492c164c52b9685e0, user_id=aae1dfdd4ab94a4d8ddad0961428cd06, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.812511 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.907333 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1437/2880] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:10 2022] PUT /identity/v3/projects/cd6aa7f793c44d1492c164c52b9685e0/users/aae1dfdd4ab94a4d8ddad0961428cd06/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:10.911244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.921821 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44758f-19a4-41f7-86dc-e22c397d8229 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.982846 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.983446 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.983721 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.984035 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.984658 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:10.986371 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee45a5-a905-4df8-ae94-d2069bb3fc70 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:10.996682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1444/2881] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:11.001718 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:11.012147 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d408fc-5507-4801-bfda-ac7f451e71ad admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:11.017870 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:11.018543 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:11.018815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:11.019081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] PATH_INFO: `/v3/projects/cd6aa7f793c44d1492c164c52b9685e0/users/aae1dfdd4ab94a4d8ddad0961428cd06/roles/bbb06ed9c58640e3bc1ad8aad3773c29` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:11.020998 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6aa7f793c44d1492c164c52b9685e0, user_id=aae1dfdd4ab94a4d8ddad0961428cd06, role_id=bbb06ed9c58640e3bc1ad8aad3773c29)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:11.023603 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:11.034619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1438/2882] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:11 2022] PUT /identity/v3/projects/cd6aa7f793c44d1492c164c52b9685e0/users/aae1dfdd4ab94a4d8ddad0961428cd06/roles/bbb06ed9c58640e3bc1ad8aad3773c29 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:51:11.045626 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:11.045907 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:11.046179 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:11.074435 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] MFA Rules not processed for user `aae1dfdd4ab94a4d8ddad0961428cd06`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:11.075815 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:11.143816 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1445/2883] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:11.155235 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:11.157120 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:11.222887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa1d1-ecb4-4fae-b63b-ddc774f473fc admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:11.226623 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:11.227239 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:11.227515 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:11.227816 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:11.240070 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:11.242014 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:11.258081 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1439/2884] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:11.503682 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:11.514451 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b60d8-86c2-434e-92ef-fc65873fac0a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:11.518014 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:11.518614 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:11.518885 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:11.519149 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:11.579688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:11.582466 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:11.584102 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:11.596631 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1446/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:14.041778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:14.043315 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:14.096450 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:14.113029 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64b79-b260-42ab-8e41-62e399f4ea19 service cinder] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:14.117581 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:14.118221 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:14.118499 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:14.118768 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] PATH_INFO: `/v3/users/970a70f1722040a8b9473b546aa2a7be` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:14.119968 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970a70f1722040a8b9473b546aa2a7be)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:14.122408 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:14.348575 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970a70f1722040a8b9473b546aa2a7be'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.349244 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970a70f1722040a8b9473b546aa2a7be'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.356049 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970a70f1722040a8b9473b546aa2a7be'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.417701 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970a70f1722040a8b9473b546aa2a7be'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.430830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970a70f1722040a8b9473b546aa2a7be'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.436811 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1440/2886] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:14 2022] DELETE /identity/v3/users/970a70f1722040a8b9473b546aa2a7be => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:14.725722 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:14.739294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d379f6-04e8-4683-971d-9d3c24db3be0 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:14.798018 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:14.798647 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:14.798928 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:14.799202 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] PATH_INFO: `/v3/projects/85f62e0ab9794cd3b843acfabba1190f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:14.800344 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f62e0ab9794cd3b843acfabba1190f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:14.802244 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:14.901578 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f62e0ab9794cd3b843acfabba1190f', 'request_id': 'req-aab7446a-7dbd-416d-906e-2730ddbcfbb0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.970197 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f62e0ab9794cd3b843acfabba1190f', 'request_id': 'req-aab7446a-7dbd-416d-906e-2730ddbcfbb0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.976637 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f62e0ab9794cd3b843acfabba1190f', 'request_id': 'req-aab7446a-7dbd-416d-906e-2730ddbcfbb0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.988038 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] The token cache is being invalidate because project 85f62e0ab9794cd3b843acfabba1190f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:14.988340 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.988978 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:14.990480 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1447/2887] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:14 2022] DELETE /identity/v3/projects/85f62e0ab9794cd3b843acfabba1190f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:14.994577 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:14.996019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:15.010491 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106babd7-a214-492c-a412-847a2b1d8029 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:15.071887 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:15.072645 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:15.072996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:15.073341 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] PATH_INFO: `/v3/users/3ded831fe7f94e7ebc104b3c0cef4929` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:15.074583 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ded831fe7f94e7ebc104b3c0cef4929)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:15.076835 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:15.248079 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ded831fe7f94e7ebc104b3c0cef4929'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:15.248752 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ded831fe7f94e7ebc104b3c0cef4929'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:15.256252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ded831fe7f94e7ebc104b3c0cef4929'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:15.337958 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ded831fe7f94e7ebc104b3c0cef4929'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:15.343383 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:15.351393 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ded831fe7f94e7ebc104b3c0cef4929'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:15.357855 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1441/2888] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:14 2022] DELETE /identity/v3/users/3ded831fe7f94e7ebc104b3c0cef4929 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:15.709492 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:15.711020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:15.725923 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7446a-7dbd-416d-906e-2730ddbcfbb0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:15.801701 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:15.802325 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:15.802599 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:15.802866 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] PATH_INFO: `/v3/projects/509bc3a9617640d28444dacb8ef92c8c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:15.803993 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=509bc3a9617640d28444dacb8ef92c8c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:15.805873 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:15.923629 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:15.940314 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509bc3a9617640d28444dacb8ef92c8c', 'request_id': 'req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:16.009468 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509bc3a9617640d28444dacb8ef92c8c', 'request_id': 'req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:16.017640 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509bc3a9617640d28444dacb8ef92c8c', 'request_id': 'req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:16.029979 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] The token cache is being invalidate because project 509bc3a9617640d28444dacb8ef92c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:16.030262 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:16.030913 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6e42b0c5-fd6d-4cd5-8160-ae63eeceb32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:16.032462 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1448/2889] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:15 2022] DELETE /identity/v3/projects/509bc3a9617640d28444dacb8ef92c8c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:18.211098 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:18.212556 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:18.226600 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071b8c-e8d6-4de7-b0b1-abbf68105cb3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:18.283619 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:18.284265 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:18.284547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:18.284820 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] PATH_INFO: `/v3/users/c28878f982854287a172b0d522a4af0f` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:18.285934 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28878f982854287a172b0d522a4af0f)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:18.287880 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:18.461330 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28878f982854287a172b0d522a4af0f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:18.461962 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28878f982854287a172b0d522a4af0f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:18.469260 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28878f982854287a172b0d522a4af0f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:18.537763 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28878f982854287a172b0d522a4af0f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:18.550830 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28878f982854287a172b0d522a4af0f'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:18.556860 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1442/2890] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:18 2022] DELETE /identity/v3/users/c28878f982854287a172b0d522a4af0f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:51:18.561333 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:18.561826 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:18.562644 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:18.587605 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:18.588872 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:18.648664 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1449/2891] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:18.659022 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:18.660477 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:18.718272 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac58d4a-ea38-4cee-a2ee-b8194463321e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:18.722592 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:18.723188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:18.723466 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:18.723738 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:18.732531 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:18.734594 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:18.743749 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1443/2892] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:19.334569 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:19.339186 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:19.350778 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c9812-ee37-4237-b8a4-d6390cf73b6b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:19.355712 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:19.356498 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:19.356837 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:19.357126 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] PATH_INFO: `/v3/projects/0adb08c986134123a1774243c0d3315c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:19.358285 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0adb08c986134123a1774243c0d3315c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:19.360929 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:19.473566 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0adb08c986134123a1774243c0d3315c', 'request_id': 'req-067a2805-8cac-4299-bc5a-45997ee5099d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.543330 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0adb08c986134123a1774243c0d3315c', 'request_id': 'req-067a2805-8cac-4299-bc5a-45997ee5099d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.550805 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0adb08c986134123a1774243c0d3315c', 'request_id': 'req-067a2805-8cac-4299-bc5a-45997ee5099d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.571270 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] The token cache is being invalidate because project 0adb08c986134123a1774243c0d3315c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:19.572132 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.572500 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.574013 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1450/2893] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:19 2022] DELETE /identity/v3/projects/0adb08c986134123a1774243c0d3315c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:19.578732 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:19.588547 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11c97-daa8-4ca5-a970-ef6b040bce48 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:19.592051 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:19.647992 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:19.648617 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:19.648897 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:19.649170 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] PATH_INFO: `/v3/users/aae1dfdd4ab94a4d8ddad0961428cd06` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:19.650291 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae1dfdd4ab94a4d8ddad0961428cd06)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:19.652248 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:19.842681 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae1dfdd4ab94a4d8ddad0961428cd06'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.843867 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae1dfdd4ab94a4d8ddad0961428cd06'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.850688 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae1dfdd4ab94a4d8ddad0961428cd06'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.914785 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae1dfdd4ab94a4d8ddad0961428cd06'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.928226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-7d2d2f8d-3247-4c4c-9871-2c9cd82c4a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae1dfdd4ab94a4d8ddad0961428cd06'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:19.934233 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1444/2894] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:19 2022] DELETE /identity/v3/users/aae1dfdd4ab94a4d8ddad0961428cd06 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:20.371358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:20.372725 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:20.386137 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2805-8cac-4299-bc5a-45997ee5099d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:20.428540 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:20.446284 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:20.447177 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:20.447457 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:20.447724 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] PATH_INFO: `/v3/projects/cd6aa7f793c44d1492c164c52b9685e0` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:20.448899 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6aa7f793c44d1492c164c52b9685e0)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:20.450898 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:20.570780 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6aa7f793c44d1492c164c52b9685e0', 'request_id': 'req-660ff024-0270-4d9d-8a30-8a41df0c1100'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:20.663553 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6aa7f793c44d1492c164c52b9685e0', 'request_id': 'req-660ff024-0270-4d9d-8a30-8a41df0c1100'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:20.670057 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6aa7f793c44d1492c164c52b9685e0', 'request_id': 'req-660ff024-0270-4d9d-8a30-8a41df0c1100'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:20.680884 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] The token cache is being invalidate because project cd6aa7f793c44d1492c164c52b9685e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:20.681170 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:20.681801 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-660ff024-0270-4d9d-8a30-8a41df0c1100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:20.683294 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1451/2895] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:20 2022] DELETE /identity/v3/projects/cd6aa7f793c44d1492c164c52b9685e0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:20.688410 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:20.696401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:20.696401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:20.709131 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:20.710314 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:20.768284 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1445/2896] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:20.776112 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:20.776395 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:20.776667 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:20.797041 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:20.798239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:20.806012 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1452/2897] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:20.810226 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:20.820502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f707-1066-4cf0-98c0-ac561de0f326 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:20.825311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:20.825908 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:20.826188 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:20.826462 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] PATH_INFO: `/v3/domains` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:20.827151 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:51:20.827546 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:20.829311 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:20.840788 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1446/2898] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 24 10:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:51:20.844972 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:20.854029 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff8cf2-5fd0-4f50-ae7c-25028858276d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:20.859158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:20.859735 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:20.860039 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:20.860301 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:20.860922 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:20.862791 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:20.960204 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1453/2899] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:20 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:20.964350 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:20.975321 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3f86-846a-4c15-a240-f8861646d90e admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:20.984252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:21.033359 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:21.033953 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.034227 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.034492 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] PATH_INFO: `/v3/users` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.035149 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:21.037065 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:21.123996 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1447/2900] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:20 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:21.128919 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:21.139289 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffbcf-5161-492e-a41a-222ff94320d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:21.144646 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:21.145261 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.145535 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.145822 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.146449 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:21.148051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:21.158020 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1454/2901] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:21.164740 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:21.172366 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae214af-52f8-4193-a6e8-ef944bd6cde3 admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:21.177073 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:21.177663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.177942 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.178213 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.178850 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:21.180468 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec491f2-43c2-4a0e-80fa-7e06829a87bb admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:21.190869 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1448/2902] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:21.194943 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:21.205639 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebe07c-2613-4371-a44e-fe3d5861450c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:21.210145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:21.210827 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.211051 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.211323 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] PATH_INFO: `/v3/projects/1d6ce7918cf24c629f8880dec3e31e52/users/c44b65d28d3f43b1b7176d4de7246c21/roles/e17d5c4e47e7496eb2e1291f09499efd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.225514 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6ce7918cf24c629f8880dec3e31e52, user_id=c44b65d28d3f43b1b7176d4de7246c21, role_id=e17d5c4e47e7496eb2e1291f09499efd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:21.228158 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:21.307698 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1455/2903] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:21 2022] PUT /identity/v3/projects/1d6ce7918cf24c629f8880dec3e31e52/users/c44b65d28d3f43b1b7176d4de7246c21/roles/e17d5c4e47e7496eb2e1291f09499efd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:21.318401 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] REQUEST_METHOD: `POST` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.318686 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.318981 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.349502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.auth.core [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] MFA Rules not processed for user `c44b65d28d3f43b1b7176d4de7246c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:21.350757 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:21.415759 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1449/2904] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:21.427352 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:21.431312 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:21.487180 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0b0f9-23f5-46ac-85fa-54cf97af182f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:21.490789 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa91470f945469798d16d84fbe4f35d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:21.491386 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:21.491663 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:21.491967 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:21.500859 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:21.502378 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5da65a-978b-49b8-a4c9-2ecd0a69526f service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:21.511178 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1456/2905] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:25.526190 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:25.591252 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70dd2-8ba6-45b0-a24b-b1727cafbeb5 None None] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:25.596786 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:25.597415 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.597678 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.597950 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] PATH_INFO: `/v3/users/c44b65d28d3f43b1b7176d4de7246c21` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.599067 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44b65d28d3f43b1b7176d4de7246c21)` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:25.601019 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:25.630004 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:25.799770 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44b65d28d3f43b1b7176d4de7246c21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:25.800459 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44b65d28d3f43b1b7176d4de7246c21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:25.807391 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44b65d28d3f43b1b7176d4de7246c21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:25.892146 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44b65d28d3f43b1b7176d4de7246c21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:25.904984 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.notifications [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44b65d28d3f43b1b7176d4de7246c21'} {{(pid=81655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:25.911037 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1450/2906] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:25 2022] DELETE /identity/v3/users/c44b65d28d3f43b1b7176d4de7246c21 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:25.915603 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:25.916145 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:25.916306 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:25.935517 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] MFA Rules not processed for user `b7197efde7064ffaa409cd8ec7c1f162`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:25.936758 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:25.941358 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:25.995927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1457/2907] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 24 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:26.006559 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:26.008114 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:26.064214 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1991a-dd07-47d0-a475-b2667e24608d admin admin] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:26.068663 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d03ed0ea7f443bf881a38c217f716e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:26.069256 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:26.069526 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:26.069790 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:26.079105 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:26.080554 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:26.090502 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1451/2908] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:26.511239 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:26.512688 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:26.526350 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76e90-7958-4f3f-8bc3-aee04ba81d5e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:26.531028 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7197efde7064ffaa409cd8ec7c1f162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ae17c3c2d745c786962a42b9714f09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:26.531660 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:26.531976 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:26.532248 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] PATH_INFO: `/v3/projects/1d6ce7918cf24c629f8880dec3e31e52` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:26.533369 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6ce7918cf24c629f8880dec3e31e52)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:26.535838 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:26.716927 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6ce7918cf24c629f8880dec3e31e52', 'request_id': 'req-15e24156-1ef9-420b-ad4b-e6b9151f2da8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:26.786593 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6ce7918cf24c629f8880dec3e31e52', 'request_id': 'req-15e24156-1ef9-420b-ad4b-e6b9151f2da8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:26.793129 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6ce7918cf24c629f8880dec3e31e52', 'request_id': 'req-15e24156-1ef9-420b-ad4b-e6b9151f2da8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:26.803373 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] The token cache is being invalidate because project 1d6ce7918cf24c629f8880dec3e31e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:26.809054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:26.809054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-15e24156-1ef9-420b-ad4b-e6b9151f2da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:26.809054 dv-cinder-854273-2-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1458/2909] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:26 2022] DELETE /identity/v3/projects/1d6ce7918cf24c629f8880dec3e31e52 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:36.085604 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=46,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:36.800523 dv-cinder-854273-2-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:41.487156 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] Authenticating user token {{(pid=81655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:41.488631 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:41.558169 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856616c1-55cd-47d7-ae4d-ef8d4128ef34 service neutron] Validating token access rules against request {{(pid=81655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:41.617040 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34849cc7b860429287542bb4bd34a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2150d48507b9449a9c373a323d24f29b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:41.617815 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] REQUEST_METHOD: `GET` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:41.618095 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] SCRIPT_NAME: `/identity` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:41.618364 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:41.620109 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.fernet_utils [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:41.630961 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:41.632566 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32b86-7d8c-40e5-8b3f-24e1a018ba59 service placement] RBAC: Authorization granted {{(pid=81655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:41.642923 dv-cinder-854273-2-smb devstack@keystone.service[81655]: [pid: 81655|app: 0|req: 1452/2910] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:51.638778 dv-cinder-854273-2-smb devstack@keystone.service[81655]: DEBUG dbcounter [-] [81655] Writing DB stats keystone:SELECT=58 {{(pid=81655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}